-- Logs begin at Mon 2022-08-29 19:26:24 UTC, end at Mon 2022-08-29 20:33:12 UTC. -- Aug 29 20:05:04.385643 dv-cinder-854262-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:05:04.393522 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:05:04 2022] *** Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: nodename: dv-cinder-854262-2-iscsi Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: machine: x86_64 Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: clock source: unix Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: pcre jit disabled Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: detected number of CPU cores: 4 Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: current working directory: / Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:05:04.396557 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: your processes number limit is 47680 Aug 29 20:05:04.397228 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: your memory page size is 4096 bytes Aug 29 20:05:04.397228 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: detected max file descriptor number: 2048 Aug 29 20:05:04.397228 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: lock engine: pthread robust mutexes Aug 29 20:05:04.397228 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: thunder lock: enabled Aug 29 20:05:04.397228 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:05:04.397228 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:05:04.435945 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: Python main interpreter initialized at 0x564ba41be9c0 Aug 29 20:05:04.435945 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: python threads support enabled Aug 29 20:05:04.435945 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: your server socket listen backlog is limited to 100 connections Aug 29 20:05:04.435945 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:05:04.436352 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:05:04.436352 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: *** Operational MODE: preforking *** Aug 29 20:05:04.436607 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:05:04.436607 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: spawned uWSGI master process (pid: 105712) Aug 29 20:05:04.436803 dv-cinder-854262-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:05:04.438221 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: spawned uWSGI worker 1 (pid: 105713, cores: 1) Aug 29 20:05:04.438221 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: spawned uWSGI worker 2 (pid: 105714, cores: 1) Aug 29 20:05:04.438221 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:05:05.099165 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:05:05.100365 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:05:06.185274 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:06.185274 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: from cryptography.utils import int_from_bytes Aug 29 20:05:06.185873 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:06.185873 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: from cryptography.utils import int_from_bytes Aug 29 20:05:06.203267 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:06.203267 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: from cryptography.utils import int_from_bytes Aug 29 20:05:06.203716 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:05:06.203716 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: from cryptography.utils import int_from_bytes Aug 29 20:05:08.685853 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:05:08.686519 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:05:08.686611 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:05:08.686963 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:05:08.687310 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:05:08.687700 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.688033 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.688352 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.688457 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:05:08.688839 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:05:08.688935 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.689027 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.689106 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:05:08.689288 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.689477 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:05:08.689607 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.689995 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:05:08.690188 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.690389 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.690513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.690719 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.690824 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.691046 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.691163 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.691392 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.691486 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-2-iscsi {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.691720 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.691806 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.692028 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.692115 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.692337 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.692432 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.692653 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.692746 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.692958 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.693052 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.693230 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.693329 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.693549 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.693654 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.693878 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-2-iscsi {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.694065 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.694248 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.694505 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.694648 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.694811 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.694935 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.695147 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.695317 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.695493 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.695618 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.695777 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.695869 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.696064 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.696160 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.696391 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.696572 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.696700 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.696890 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.697023 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.697199 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.697334 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.697535 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.697732 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-2-iscsi {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.697884 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.698048 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.698151 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.698373 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.698515 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.698675 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.698764 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.699068 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.699184 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.699415 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.699558 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.699725 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.699825 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.700070 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.700156 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-2-iscsi {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.700395 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.700493 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.700704 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.700791 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.701031 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.701119 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.701349 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.701475 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.701670 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.701810 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.701991 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.702079 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.702294 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.702389 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.702603 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.702773 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.702915 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.703003 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.703272 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.703362 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.703581 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.703686 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.703889 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.703982 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.704143 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.704302 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.704455 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.704556 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.704777 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.704866 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.705105 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.705192 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.705428 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.705519 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.705680 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.705769 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.705930 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.706067 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.706251 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.706346 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.706574 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.706662 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.706884 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.706979 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.707218 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.707319 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.707527 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.707679 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.707825 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.707926 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.708080 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.708168 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.708402 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.708532 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.708717 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.708815 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.709024 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.709111 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.709333 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.709419 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.709655 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.709863 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.709951 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.710019 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.710393 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.710498 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.710596 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.710685 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.710852 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.711025 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.711317 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.711411 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.711506 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.711679 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.711797 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.712021 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.712120 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.712339 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.712429 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.712646 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.712733 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.712967 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.713115 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.713287 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.713376 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.713593 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.713688 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.713898 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.713997 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.714223 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.714362 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.714522 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.714609 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.714854 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.714954 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.715187 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.715280 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.715440 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.715539 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.715769 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.715906 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.716072 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.716220 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.716391 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.716544 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.716696 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.716885 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.717002 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.717194 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.717290 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.717445 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.717593 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.717751 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.717898 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.718059 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.718201 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.718380 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.718506 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.718690 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.718810 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.718998 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.719136 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.719331 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.719431 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.719679 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.719781 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.719945 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.720041 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.720254 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.720349 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.720667 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.720775 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.720857 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.720935 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.721167 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.721262 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.721474 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.721570 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.721782 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.721871 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.722087 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.722181 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.722389 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.722476 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.722695 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.722782 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.722999 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.723124 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.723339 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.723437 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.723641 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.723726 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.723944 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.724040 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.724251 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.724347 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.724554 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.724644 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.724865 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.724960 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.725171 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.725257 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.725468 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.725554 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.725772 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.725871 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.726088 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.726176 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.726472 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.726573 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.726742 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.726829 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.727058 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.727181 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.727383 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.727468 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.727686 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.727783 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.727989 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.728094 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.728291 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.728389 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.728594 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.728725 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.728893 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.728980 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.729197 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.729289 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.729503 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.729618 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.729807 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.729893 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.730111 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.730208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.730412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.730499 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.730714 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.730808 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.731016 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.731139 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.731886 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.731980 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.732212 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.732299 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.732525 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.732625 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.732833 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.732921 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.733141 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.733233 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.733464 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:05:08.733561 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.733802 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.733897 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.734127 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.734221 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.734456 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.734589 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.734769 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.734857 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.735131 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.735224 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.735423 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.735518 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.735743 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.735830 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.736061 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.736147 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.736377 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.736529 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.736693 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.736788 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.737007 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.737108 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.737323 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.737419 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.737633 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.737720 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.737950 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.738036 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.738270 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.738357 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.738590 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.738675 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.738900 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.738997 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.739240 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.739330 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.739563 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.739650 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.739879 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.739980 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.740224 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.740320 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.740519 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.740604 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.740875 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.741088 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.741185 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.741308 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.741478 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.741575 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.741824 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.741920 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.742143 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.742271 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.742458 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.742544 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.742776 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.742877 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.743125 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.743229 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.743424 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.743516 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.743736 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.743842 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.744045 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.744192 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.744357 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.744444 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.744670 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.744758 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.744985 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.745097 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.745300 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.745389 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.745628 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.745721 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.745944 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.746034 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.746256 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.746345 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.746567 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.746658 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.746924 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.747577 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.747780 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.747879 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.748121 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.748213 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.748431 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.748520 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.748739 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.748853 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.749048 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.749157 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.749353 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.749444 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.749665 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.749762 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.749973 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.750067 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.750285 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.750377 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.750602 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.750699 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.750908 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.750996 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.751240 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.751345 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.751553 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.751650 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.751863 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.751950 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.752170 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.752256 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.752478 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.752568 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.752785 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.752872 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.753099 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.753185 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.753409 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.753500 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.753714 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.753810 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.754028 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.754114 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.754337 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.754433 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.754644 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.754770 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.754952 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.755040 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.755289 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.755379 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.755604 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.755689 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.755913 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.756018 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.756221 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.756307 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.756532 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.756619 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.756837 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.756932 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.757152 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.757253 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.757462 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.757548 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.757775 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.757870 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.758087 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.758235 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.758594 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.758698 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.758919 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.759048 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.759214 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.759302 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.759382 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.759460 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.759676 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.759765 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.760025 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.760207 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.760313 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.760399 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.760642 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.760728 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.760948 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.761045 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.761255 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.761342 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.761561 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.761646 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.761875 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.761967 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.762183 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.762267 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.762506 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.762607 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.762814 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.762899 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.763139 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.763249 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.763531 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.763752 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.763836 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.764065 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.764157 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.764370 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.764464 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.764674 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.764764 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.764974 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.765067 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.765280 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.765364 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.765590 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.765675 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.765915 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.766009 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.766227 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.766311 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.766535 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.766620 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.766843 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.766935 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.767170 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.767257 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.767517 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.767602 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.767825 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.767909 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.768136 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.768220 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.768450 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.768535 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.768762 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.768848 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.769083 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.769167 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.769394 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.769479 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.769714 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.769800 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.770024 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.770110 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.770336 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.770429 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.770647 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.770731 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.770959 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.771050 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.771288 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.771385 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.771605 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.771690 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.771955 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.772051 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.772266 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.772592 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.772680 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.772748 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.772893 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.772980 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.773216 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.773315 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.773527 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.773611 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.773845 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.773937 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.774191 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.774283 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.774502 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.774602 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.774814 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.774905 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.775165 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.775257 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.775480 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.775564 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.775798 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.775881 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.776109 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.776195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.776421 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.776505 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.776730 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.776814 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.777042 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.777134 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.777343 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.777427 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.777658 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.777742 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.777981 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.778066 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.778343 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.778476 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.778667 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.778761 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.778979 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.779063 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.779324 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.779408 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.779632 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.779725 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.779942 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.780026 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.780251 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.780335 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.780555 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.780647 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.780863 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.780947 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.781173 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.781257 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.781489 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.781588 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.781800 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.781892 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.782111 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.782194 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.782415 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.782502 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.782721 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.782804 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.783027 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.783141 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.783357 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.783450 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.783660 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.783752 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.783971 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.784055 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.784280 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.784364 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.784588 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.784673 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.784906 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.784990 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.785217 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.785302 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.785523 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.785607 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.785827 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.785924 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.786139 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.786228 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.786450 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.786541 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.786756 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.786854 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.787063 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.787172 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.787393 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.787478 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.787725 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.787822 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.788032 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.788116 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.788334 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.788418 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.788652 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.788752 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.788955 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.789047 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.789261 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.789353 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.789569 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.789668 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.789876 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.789960 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.790184 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.790268 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.790503 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.790589 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.790817 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.790900 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.791216 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.791356 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.791447 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.791527 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.791752 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.791846 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.792063 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.792149 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.792371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.792455 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.792691 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.792782 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.792999 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.793128 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.793307 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.793400 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.793614 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.793698 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.794454 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.794548 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.794765 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.794849 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.795095 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.795234 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.795428 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.795670 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.795781 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.796002 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.796086 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.796316 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.796407 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.796630 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.796715 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.796944 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.797035 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.797264 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.797358 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.797597 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.797836 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.797922 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.798173 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.798258 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.798491 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.798581 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.798808 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.798953 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.799133 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.799223 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.799440 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.799577 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.799750 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.799851 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.800055 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.800140 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.800361 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.800446 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.800666 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.800759 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.800977 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.801068 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.801281 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.801365 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.801586 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.801672 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.801890 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.801975 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.802196 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.802281 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.802503 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.802588 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.802807 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.802890 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.803139 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.803238 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.803449 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.803541 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.803760 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.803855 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.804069 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.804176 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.804383 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.804537 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.804696 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.804784 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.805004 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.805098 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.805315 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.805400 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.805621 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.805713 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.805949 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.806043 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.806259 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.806344 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.806564 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.806649 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.806871 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.807034 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.807202 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.807291 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.807538 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.807622 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.807846 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.807932 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.808150 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.808235 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.808457 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.808543 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.808770 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.808867 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.809079 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.809164 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.809970 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.810111 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.810293 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.810379 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.810608 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.810694 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.810918 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.811011 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.811251 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.811340 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.811565 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.811650 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.811876 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.811972 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.812180 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.812264 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.812493 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.812576 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.812805 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.812903 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.813112 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.813199 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.813417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.813502 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.813721 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.813814 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.814031 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.814115 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.814336 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.814419 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.814644 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.815013 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.815254 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.815355 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.815564 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.815655 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.815874 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.815960 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.816177 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.816260 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.816482 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.816566 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.816788 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.816875 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.817095 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.817179 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.817403 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.817490 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.817728 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.817814 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.818035 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.818120 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.818336 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.818420 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.818641 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.818726 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.818947 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.819036 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.819277 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.819381 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.819580 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.819665 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.819890 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.819975 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.820203 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.820300 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.820511 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.820653 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.820813 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.820908 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.821121 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.821215 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.821422 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.821513 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.821726 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.821811 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.822030 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.822124 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.822337 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.822422 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.822639 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.822723 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.822941 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.823034 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.823266 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.823353 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.823570 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.823665 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.823871 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.823956 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.824176 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.824260 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.824487 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.824572 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.824787 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.824871 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.825115 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.825204 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.825416 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.825545 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.825719 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.825804 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.826026 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.826110 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.826353 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.826451 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.826664 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.826757 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.826972 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.827056 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.827305 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.827475 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.827617 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.827701 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.827926 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.828011 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.828242 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.828339 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.828549 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.828640 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.828864 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.828986 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.829174 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.829267 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.829490 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.829574 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.829796 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.829887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.830099 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.830192 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.830412 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.830496 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.830720 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.830810 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.831029 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.831143 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.831365 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.831448 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.831683 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.831767 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.831991 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.832084 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.832296 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.832380 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.832605 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.832690 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.832916 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.833001 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.833223 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.833307 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.833532 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.833616 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.833842 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.833927 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.834153 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.834238 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.834462 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.834554 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.834792 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.834888 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.835116 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.835206 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.835423 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.835522 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.835737 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.835822 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.836050 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.836136 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.836364 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.836528 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.836668 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.836752 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.836982 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.837064 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.837291 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.837382 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.837595 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.837680 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.837902 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.837989 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.838207 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.838300 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.838517 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.838600 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.838818 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.838902 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.839179 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.839267 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.839496 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.839591 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.839805 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.839896 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.840117 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.840214 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.840425 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.840513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.840763 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.840894 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.841074 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.841188 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.841417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.841542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.841723 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.841843 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.842120 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.842232 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.842431 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.842543 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.842740 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.842859 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.843054 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.843226 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.843383 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.843492 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.843691 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.843815 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.844002 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.844111 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.844326 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.844436 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.844632 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.844752 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.844938 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.845049 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.845243 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.845355 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.845572 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.845684 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.845876 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.845994 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.846197 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.846288 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.846531 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.846625 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.846839 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.846924 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.847168 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.847348 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.847478 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.847765 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.847850 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.848076 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.848168 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.848388 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.848481 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.848742 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.848849 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.849067 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.849188 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.849393 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.849491 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.849699 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.849868 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.850014 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.850181 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.850442 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.850582 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.850726 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.850857 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.851051 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.851187 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.851386 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.851472 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.851703 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.851801 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.852010 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.852095 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.852335 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.852421 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.852659 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.852745 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.852972 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.853057 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.853285 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.853370 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.853605 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.853698 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.853916 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.854001 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.854244 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.854339 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.854572 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.854666 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.854890 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.854976 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.855240 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.855344 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.855557 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.855663 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.855870 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.855991 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.856176 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.856821 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.856998 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.857151 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.857403 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.857521 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.857729 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.857828 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.858045 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.858133 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.858360 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.858452 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.858672 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.858758 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.858976 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.859068 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.859310 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.859396 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.859636 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.859723 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.859941 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.860034 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.860262 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.860346 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.860576 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.860663 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.860885 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.860971 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.861193 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.861278 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.861498 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.861590 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.861815 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.861911 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.862123 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.862217 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.862428 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.862513 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.862734 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.862820 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.863039 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.863160 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.863385 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.863469 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.863697 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.863781 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.864010 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.864103 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.864317 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.864403 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.864625 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.864717 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.864933 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.865027 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.865276 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.865361 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.865583 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.865678 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.865906 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.865993 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.866229 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.866312 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.866553 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.866639 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.866860 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.866946 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.867189 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.867280 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.867502 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.867599 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.867847 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.867934 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.868176 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.868267 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.868484 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.868569 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.868796 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.868882 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.869100 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.869185 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.869404 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.869496 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.869705 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.869797 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.870014 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.870098 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.870320 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.870412 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.870633 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.870763 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.870940 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.871025 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.871270 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.871366 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.871576 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.871660 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.871977 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.872583 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.872807 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.872902 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.873138 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.873225 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.873455 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.873541 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.873765 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.873851 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.874076 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.874169 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.874384 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.874470 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.874700 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.874792 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.875019 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.875151 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.875363 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.875462 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.875679 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.875765 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.875994 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.876078 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.876317 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.876401 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.876628 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.876714 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.876946 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.877031 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.877263 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.877397 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.877580 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.877666 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.877898 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.878127 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.878263 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.878461 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.878548 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.878778 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.878863 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.879109 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.879233 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.879464 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.879642 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.880006 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.880193 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.880341 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.880661 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.880978 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.881295 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.881545 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.881633 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.881870 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.881965 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.882197 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.882323 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.882514 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.882652 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.882833 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.883134 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.883291 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.883476 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.883628 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.883805 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.883953 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.884135 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.884307 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.884477 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.884627 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.884799 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.884958 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.886796 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.887467 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.887467 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.887657 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.887657 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.887894 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.887894 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888042 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888128 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888221 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888348 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888436 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888516 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888593 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888670 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888757 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888837 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888913 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.888989 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889073 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889159 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889239 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889316 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889401 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889479 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889557 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889642 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889721 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889798 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889874 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.889959 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.890038 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.890123 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.890202 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.890377 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.890466 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.890714 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.890809 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.891036 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.891155 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.891376 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.891499 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.891691 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.891790 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.892006 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.892091 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.892536 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.892623 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.892854 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.893012 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.893191 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.893285 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.893519 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.893604 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.893846 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.893941 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.894165 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.894249 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.894486 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.894581 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.894814 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.894900 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.895145 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.895236 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.895457 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.895543 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.895773 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.895859 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.896084 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.896168 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.896389 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.896475 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.896713 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.896799 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.897024 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.897116 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.897343 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.897503 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.897665 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.897964 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.898082 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.898165 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.898486 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.898841 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.898946 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.899177 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.899475 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.899562 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.899826 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.899974 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.900148 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.900459 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.900545 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.900789 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.900875 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.901101 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.901189 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.901412 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.901555 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.901731 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.901822 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.902046 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.902134 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.902355 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.902441 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.902664 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.902758 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.902980 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.903065 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.903384 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.903483 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.903679 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.903772 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.903996 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.904078 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.904306 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.904383 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.904614 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.904707 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.904926 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.905020 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.905233 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.905318 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.905543 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.905642 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.905857 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.905942 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.906161 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.906245 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.906469 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.906554 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.906776 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.906864 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.907108 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.907196 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.907418 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.907505 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.907728 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.907821 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.908033 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.908118 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.908344 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.908430 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.908650 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.908737 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.908957 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.909042 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.909261 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.909346 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.909574 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.909659 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.909880 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.909973 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.910189 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.910275 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.910514 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.910598 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.910835 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.910933 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.911176 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.911268 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.911505 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.911591 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.911819 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.911922 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.912134 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.912220 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.912457 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.912541 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.912771 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.912870 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.913085 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.913317 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.913433 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.913658 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.913753 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.913984 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.914275 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.914360 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.914611 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.914697 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.914935 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.915022 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.915268 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.915355 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.915580 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.915681 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.915909 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.915997 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.916217 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.916301 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.916526 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.916612 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.916839 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.916925 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.917156 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.917248 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.917472 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.917567 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.917785 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.917871 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.918097 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.918181 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.918407 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.918501 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.918715 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.919361 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.919559 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.919645 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.919870 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.919973 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.920181 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.920268 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.920488 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.920573 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.920797 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.920925 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.921106 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.921191 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.921415 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.921510 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.921724 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.921846 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.922039 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.922126 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.922369 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.922462 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.922687 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.922782 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.923001 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.923104 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.923344 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.923508 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.923658 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.923746 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.923967 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.924052 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.924278 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.924373 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.924589 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.924681 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.924900 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.924986 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.925207 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.925305 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.925535 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.925641 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.925847 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.925962 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.926153 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.926284 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.926578 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.926664 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.926895 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.926990 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.927242 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.927334 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.927567 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.927655 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.927878 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.927971 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.928201 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.928288 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.928511 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.928620 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.928828 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.928926 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.929150 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.929236 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.929462 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.929554 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.929792 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.929886 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.930103 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.930199 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.930413 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.930507 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.930722 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.930817 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.931035 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.931151 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.931374 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.931459 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.931682 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.931817 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.931987 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.932075 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.932294 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.932380 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.932602 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.932688 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.932907 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.933001 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.933210 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.933295 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.933515 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.933601 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.933816 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.933900 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.934121 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.934206 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.934475 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.935102 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.935325 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.935413 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.935636 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.935736 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.935992 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.936086 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.936251 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.936345 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.936556 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.936651 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.936858 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.936943 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.937162 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.937255 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.937473 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.937568 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.937784 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.937877 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.938086 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.938171 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.938390 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.938485 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.938692 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.938777 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.938996 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.939108 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.939324 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.939412 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.939657 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.940012 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.940259 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.940383 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.940577 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.940672 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.940890 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.940976 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.941203 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.941288 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.941529 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.941622 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.941839 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.941925 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.942149 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.942241 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.942476 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.942570 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.942786 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.942880 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.943156 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.943262 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.943431 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.943524 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.943745 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.943831 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.944062 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.944212 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.944375 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.944526 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.944674 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.944773 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.944981 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.945077 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.945291 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.945377 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.945618 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.945703 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.945937 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.946074 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.946243 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.946328 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.946568 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.946661 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.946883 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.946970 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.947231 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.947319 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.947544 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.947629 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.947854 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.947942 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.948166 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.948251 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.948483 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.948568 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.948795 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.948882 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.949106 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.949191 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.949415 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.949515 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.949725 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.949810 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.950067 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.950159 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.950383 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.950516 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.950694 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.950849 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.951011 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.951120 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.951348 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.951458 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.951675 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.951760 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.952002 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.952135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.952312 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.952398 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.952639 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.952725 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.952968 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.953054 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.953312 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.953399 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.953626 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.953710 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.953936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.954021 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.954244 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.954331 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.954489 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:05:08.954582 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.954887 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.955223 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:05:08.955468 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:05:09.108330 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO dbcounter [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Registered counter for database nova_api Aug 29 20:05:09.109384 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO dbcounter [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Registered counter for database nova_api Aug 29 20:05:09.128322 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_db.sqlalchemy.engines [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.130095 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_db.sqlalchemy.engines [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.135241 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writer thread running {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.137265 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writer thread running {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.193059 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.context [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05f1666c-b639-455a-b175-1a63fa7e82b0(cell1) {{(pid=105713) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:05:09.194167 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.context [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05f1666c-b639-455a-b175-1a63fa7e82b0(cell1) {{(pid=105714) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:05:09.196840 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_concurrency.lockutils [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:05:09.197326 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_concurrency.lockutils [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:05:09.197954 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:05:09.198425 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:05:09.198911 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_concurrency.lockutils [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:05:09.199743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_concurrency.lockutils [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:05:09.201096 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_concurrency.lockutils [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:05:09.201216 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:05:09.201216 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:05:09.201449 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:05:09.202303 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_concurrency.lockutils [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:05:09.203454 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:05:09.204340 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO dbcounter [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Registered counter for database nova_cell0 Aug 29 20:05:09.205418 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO dbcounter [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Registered counter for database nova_cell0 Aug 29 20:05:09.208458 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO dbcounter [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Registered counter for database nova_cell1 Aug 29 20:05:09.209596 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO dbcounter [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Registered counter for database nova_cell1 Aug 29 20:05:09.216270 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_db.sqlalchemy.engines [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.218496 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_db.sqlalchemy.engines [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.220933 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_db.sqlalchemy.engines [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.221917 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_db.sqlalchemy.engines [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.222366 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writer thread running {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.229004 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writer thread running {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.230468 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writer thread running {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.361373 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writer thread running {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.371354 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO dbcounter [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Registered counter for database nova_cell0 Aug 29 20:05:09.374955 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO dbcounter [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Registered counter for database nova_cell0 Aug 29 20:05:09.380221 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG oslo_db.sqlalchemy.engines [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.383879 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_db.sqlalchemy.engines [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:05:09.385010 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writer thread running {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.389092 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writer thread running {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:05:09.723101 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: WARNING keystonemiddleware.auth_token [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:05:09.730460 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: WARNING keystonemiddleware.auth_token [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:05:09.733058 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: WARNING keystonemiddleware.auth_token [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:05:09.740355 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: WARNING keystonemiddleware.auth_token [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:05:10.077516 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: WARNING keystonemiddleware.auth_token [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:05:10.082619 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: WARNING keystonemiddleware.auth_token [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:05:10.087865 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ba41be9c0 pid: 105714 (default app) Aug 29 20:05:10.089902 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:05:10.090028 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: WARNING keystonemiddleware.auth_token [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:05:10.091925 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] 10.222.0.121 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001807 Aug 29 20:05:10.091925 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 1/1] 10.222.0.121 () {50 vars in 793 bytes} [Mon Aug 29 20:05:10 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:05:10.096099 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: WARNING keystonemiddleware.auth_token [None req-350788e3-246d-4d5d-9cc5-9c7bf5e94e55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:05:10.101420 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ba41be9c0 pid: 105713 (default app) Aug 29 20:06:28.205069 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:28.206354 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001707 Aug 29 20:06:28.206852 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 2/2] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:28 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:28.219110 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writing DB stats nova_api:SELECT=3 {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:28.220564 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writing DB stats nova_cell1:SELECT=3 {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:28.221632 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writing DB stats nova_cell0:SELECT=3 {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:28.222976 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:29.138465 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-e58f0007-0b58-4c49-9f0b-d8c031af9fc5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:29.172432 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-e58f0007-0b58-4c49-9f0b-d8c031af9fc5 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.958482 Aug 29 20:06:29.173332 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 1/3] 10.222.0.121 () {60 vars in 1297 bytes} [Mon Aug 29 20:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:31.601592 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:31.602840 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-8706e9e6-b0a3-4810-ab01-ef7afa9cee01 None None] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001587 Aug 29 20:06:31.604925 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 3/4] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:31 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:32.051184 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-fcb98b33-75b9-4a1e-9335-e4175eff5719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:32.098317 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-fcb98b33-75b9-4a1e-9335-e4175eff5719 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.489045 Aug 29 20:06:32.098875 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 2/5] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:32.113216 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_api:SELECT=3 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.114345 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_cell1:SELECT=3 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.115753 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_cell0:SELECT=3 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.116807 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.344532 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-73c7636c-d628-42a1-bcce-30e676582a5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:32.408050 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-73c7636c-d628-42a1-bcce-30e676582a5c admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.300130 Aug 29 20:06:32.408638 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 4/6] 10.222.0.121 () {64 vars in 1341 bytes} [Mon Aug 29 20:06:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:34.794625 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-fcb98b33-75b9-4a1e-9335-e4175eff5719 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:34.795719 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-fcb98b33-75b9-4a1e-9335-e4175eff5719 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001528 Aug 29 20:06:34.796304 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 3/7] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:34 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:35.499030 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-8f231e61-035a-44a2-896d-20e2b3cb3140 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1"}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:35.539469 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-8f231e61-035a-44a2-896d-20e2b3cb3140 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.736912 Aug 29 20:06:35.540719 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 5/8] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:35.554622 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-84962179-41e3-402b-8168-1cea75a1bd01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:35.594596 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-84962179-41e3-402b-8168-1cea75a1bd01 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044061 Aug 29 20:06:35.603644 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 4/9] 10.222.0.121 () {64 vars in 1341 bytes} [Mon Aug 29 20:06:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:06:37.982594 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-8f231e61-035a-44a2-896d-20e2b3cb3140 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:37.983657 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-8f231e61-035a-44a2-896d-20e2b3cb3140 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001499 Aug 29 20:06:37.984059 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 6/10] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:37 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:38.391390 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-f3a5cf03-9d83-433c-9f4d-34c7953b0f12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:38.410437 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-f3a5cf03-9d83-433c-9f4d-34c7953b0f12 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420328 Aug 29 20:06:38.410917 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 5/11] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:38.423500 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-94ac3397-7824-46ed-8383-77be7898c533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:38.448342 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-94ac3397-7824-46ed-8383-77be7898c533 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028452 Aug 29 20:06:38.449023 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 7/12] 10.222.0.121 () {64 vars in 1341 bytes} [Mon Aug 29 20:06:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:06:40.861757 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-f3a5cf03-9d83-433c-9f4d-34c7953b0f12 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:40.862827 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-f3a5cf03-9d83-433c-9f4d-34c7953b0f12 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001551 Aug 29 20:06:40.863499 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 6/13] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:40 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:41.342795 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-87bc9bf8-a4a6-4049-9ea0-e91079b1767a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "disk": 10}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:41.365862 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-87bc9bf8-a4a6-4049-9ea0-e91079b1767a admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.494903 Aug 29 20:06:41.367124 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 8/14] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:41.379612 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-c343d060-9a7a-4750-8f27-d23c89f84c6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:41.409534 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-c343d060-9a7a-4750-8f27-d23c89f84c6f admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033857 Aug 29 20:06:41.410522 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 7/15] 10.222.0.121 () {64 vars in 1341 bytes} [Mon Aug 29 20:06:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:43.783432 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-87bc9bf8-a4a6-4049-9ea0-e91079b1767a admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:43.784334 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-87bc9bf8-a4a6-4049-9ea0-e91079b1767a admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001485 Aug 29 20:06:43.784734 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 9/16] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:44.246527 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-2fe084bf-3f62-47c9-9525-4f0c57495f90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "vcpus": 4}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:44.271070 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-2fe084bf-3f62-47c9-9525-4f0c57495f90 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479148 Aug 29 20:06:44.271865 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 8/17] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:44.284723 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-43d71492-76d5-4256-b8a2-7ab647e5c13b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:44.311462 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-43d71492-76d5-4256-b8a2-7ab647e5c13b admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030368 Aug 29 20:06:44.312208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 10/18] 10.222.0.121 () {64 vars in 1341 bytes} [Mon Aug 29 20:06:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:46.716384 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-2fe084bf-3f62-47c9-9525-4f0c57495f90 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:46.717440 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-2fe084bf-3f62-47c9-9525-4f0c57495f90 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001495 Aug 29 20:06:46.718005 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 9/19] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:46 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:47.194875 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-018a79fa-e2e3-4d43-b11b-74254edd2b79 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:47.220881 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-018a79fa-e2e3-4d43-b11b-74254edd2b79 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.495076 Aug 29 20:06:47.221392 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 11/20] 10.222.0.121 () {60 vars in 1297 bytes} [Mon Aug 29 20:06:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:06:49.665908 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-2fe084bf-3f62-47c9-9525-4f0c57495f90 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:49.667442 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-2fe084bf-3f62-47c9-9525-4f0c57495f90 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001912 Aug 29 20:06:49.667995 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 10/21] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:49 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:50.102322 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-458bb1c4-40f5-41ab-a73f-b364893747b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:50.123496 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-458bb1c4-40f5-41ab-a73f-b364893747b8 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449444 Aug 29 20:06:50.124048 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 12/22] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:50.136045 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-a8c18009-48ae-4b15-b546-745b81b4eb9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:50.159862 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-a8c18009-48ae-4b15-b546-745b81b4eb9a admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027455 Aug 29 20:06:50.160435 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 11/23] 10.222.0.121 () {64 vars in 1338 bytes} [Mon Aug 29 20:06:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:52.518864 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-458bb1c4-40f5-41ab-a73f-b364893747b8 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:52.519832 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-458bb1c4-40f5-41ab-a73f-b364893747b8 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001496 Aug 29 20:06:52.520235 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 13/24] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:52.922078 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-c6c92f73-9df6-4fec-b6fa-fb83b0972ea2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "name": "m1.small"}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:52.941008 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-c6c92f73-9df6-4fec-b6fa-fb83b0972ea2 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.414541 Aug 29 20:06:52.941570 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 12/25] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:06:52.954279 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-48c2f642-1a8a-4686-8099-681cbae87fac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:52.978898 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-48c2f642-1a8a-4686-8099-681cbae87fac admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028217 Aug 29 20:06:52.979533 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 14/26] 10.222.0.121 () {64 vars in 1338 bytes} [Mon Aug 29 20:06:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:55.308891 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-c6c92f73-9df6-4fec-b6fa-fb83b0972ea2 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:55.309931 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-c6c92f73-9df6-4fec-b6fa-fb83b0972ea2 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001534 Aug 29 20:06:55.310340 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 13/27] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:55 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:55.744391 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-e471a749-2b13-429f-8886-bb066f94223a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "ram": 4096, "swap": 0, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:55.764477 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-e471a749-2b13-429f-8886-bb066f94223a admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.447684 Aug 29 20:06:55.765038 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 15/28] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:55.777698 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-bb9e2972-f67d-4eb2-8718-b653ed41a2f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:55.807364 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-bb9e2972-f67d-4eb2-8718-b653ed41a2f7 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033753 Aug 29 20:06:55.807867 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 14/29] 10.222.0.121 () {64 vars in 1338 bytes} [Mon Aug 29 20:06:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:06:58.252479 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-e471a749-2b13-429f-8886-bb066f94223a admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:06:58.253658 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-e471a749-2b13-429f-8886-bb066f94223a admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001455 Aug 29 20:06:58.254250 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 16/30] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:06:58 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:06:58.710201 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-493423f3-4de3-49e4-8ecf-a6b9984ad052 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:58.716303 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.735182 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-493423f3-4de3-49e4-8ecf-a6b9984ad052 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.472212 Aug 29 20:06:58.736327 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 15/31] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:06:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:06:58.747953 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-cc0216fb-9f9c-4541-aac9-d15be93475e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:06:58.776397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-cc0216fb-9f9c-4541-aac9-d15be93475e4 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031908 Aug 29 20:06:58.777449 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 17/32] 10.222.0.121 () {64 vars in 1338 bytes} [Mon Aug 29 20:06:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:01.173393 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-493423f3-4de3-49e4-8ecf-a6b9984ad052 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:01.174409 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-493423f3-4de3-49e4-8ecf-a6b9984ad052 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001455 Aug 29 20:07:01.179322 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 16/33] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:07:01 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:01.620895 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-d3467cf5-0e4c-4bb1-a5d2-b8cb5cee695e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:07:01.642174 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-d3467cf5-0e4c-4bb1-a5d2-b8cb5cee695e admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.461101 Aug 29 20:07:01.642709 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 18/34] 10.222.0.121 () {64 vars in 1288 bytes} [Mon Aug 29 20:07:01 2022] POST /compute/v2.1/flavors => generated 410 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:07:01.656596 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-860e6629-fd7a-4676-a86b-2f1658fd682b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:07:01.683655 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-860e6629-fd7a-4676-a86b-2f1658fd682b admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032650 Aug 29 20:07:01.684640 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 17/35] 10.222.0.121 () {64 vars in 1338 bytes} [Mon Aug 29 20:07:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:07:22.069390 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-d3467cf5-0e4c-4bb1-a5d2-b8cb5cee695e admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:22.070398 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-d3467cf5-0e4c-4bb1-a5d2-b8cb5cee695e admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001448 Aug 29 20:07:22.070797 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 19/36] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:07:22 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:22.082600 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.460795 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-66b17eb4-cb7c-4dd3-89f3-5a383e761671 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:22.481136 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-66b17eb4-cb7c-4dd3-89f3-5a383e761671 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.402877 Aug 29 20:07:22.481668 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 18/37] 10.222.0.121 () {60 vars in 1297 bytes} [Mon Aug 29 20:07:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:07:23.535973 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-d3467cf5-0e4c-4bb1-a5d2-b8cb5cee695e admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:23.537074 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-d3467cf5-0e4c-4bb1-a5d2-b8cb5cee695e admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001658 Aug 29 20:07:23.537470 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 20/38] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:23 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:24.060751 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-5c584f8e-f471-4f79-8c1a-8dbdb1d9cc66 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:24.066528 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.wsgi [None req-5c584f8e-f471-4f79-8c1a-8dbdb1d9cc66 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-5c584f8e-f471-4f79-8c1a-8dbdb1d9cc66 admin admin] Request method failure captured: Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Accept: application/json Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Accept-Encoding: gzip, deflate Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Connection: keep-alive Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Content-Length: 0 Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Host: 10.222.0.121 Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Openstack-Api-Version: compute 2.90 Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Openstack-System-Scope: None Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: User-Agent: python-novaclient Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Auth-Token: gAAAAABjDRx7jdm0qsf3ffgEI-lG7p3yQB7IYujgtPDEe1NyA3mHXTu-yyy1aaPhQSiDYvcTAl2H5FHuCism8QacIt7k20UrrBr_YYrVHj1Dp0BY6CW8j6VNxGWGZwcogjbwEKyw5O7V_0Qr0-YXiK-9746EveHuiauwydcWxTBZsZperyQhN90 Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Domain-Id: None Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Domain-Name: None Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Identity-Status: Confirmed Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Is-Admin-Project: True Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Domain-Id: default Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Domain-Name: Default Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Name: admin Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Role: reader,admin,member Aug 29 20:07:24.069743 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Roles: reader,admin,member Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_94d75b22eada4bbea4e05854ad636ead", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}] Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant: admin Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant-Name: admin Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User: admin Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Domain-Id: default Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Domain-Name: Default Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Id: 2b754541a9ba4f359a8bce9ae9a5b84d Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Name: admin Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: method: > Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: exception: Flavor 42 could not be found. Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: action_args: {'id': '42'} Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:07:24.071349 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:24.072443 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.074195 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-5c584f8e-f471-4f79-8c1a-8dbdb1d9cc66 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:07:24.075246 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-5c584f8e-f471-4f79-8c1a-8dbdb1d9cc66 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395922 Aug 29 20:07:24.075246 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 19/39] 10.222.0.121 () {60 vars in 1195 bytes} [Mon Aug 29 20:07:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:24.081356 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-79818b19-8f59-4c29-ae3d-897db3344e3d admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:24.085570 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.107045 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-79818b19-8f59-4c29-ae3d-897db3344e3d admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.029200 Aug 29 20:07:24.107629 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 21/40] 10.222.0.121 () {60 vars in 1215 bytes} [Mon Aug 29 20:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:07:24.117518 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-5cde2986-fbd6-487f-ae9e-9429c2f8be5f admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:24.144075 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-5cde2986-fbd6-487f-ae9e-9429c2f8be5f admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.030051 Aug 29 20:07:24.144647 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 20/41] 10.222.0.121 () {60 vars in 1215 bytes} [Mon Aug 29 20:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:07:24.154968 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-bd67614b-c93a-4789-9c0a-6a2117fd6036 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:24.161329 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.wsgi [None req-bd67614b-c93a-4789-9c0a-6a2117fd6036 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-bd67614b-c93a-4789-9c0a-6a2117fd6036 admin admin] Request method failure captured: Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Accept: application/json Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Accept-Encoding: gzip, deflate Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Connection: keep-alive Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Content-Length: 0 Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Host: 10.222.0.121 Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Openstack-Api-Version: compute 2.90 Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Openstack-System-Scope: None Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: User-Agent: python-novaclient Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Auth-Token: gAAAAABjDRx7jdm0qsf3ffgEI-lG7p3yQB7IYujgtPDEe1NyA3mHXTu-yyy1aaPhQSiDYvcTAl2H5FHuCism8QacIt7k20UrrBr_YYrVHj1Dp0BY6CW8j6VNxGWGZwcogjbwEKyw5O7V_0Qr0-YXiK-9746EveHuiauwydcWxTBZsZperyQhN90 Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Domain-Id: None Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Domain-Name: None Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Identity-Status: Confirmed Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Is-Admin-Project: True Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Domain-Id: default Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Domain-Name: Default Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Name: admin Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Role: reader,admin,member Aug 29 20:07:24.164599 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Roles: reader,admin,member Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_94d75b22eada4bbea4e05854ad636ead", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}] Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant: admin Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant-Name: admin Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User: admin Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Domain-Id: default Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Domain-Name: Default Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Id: 2b754541a9ba4f359a8bce9ae9a5b84d Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Name: admin Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: method: > Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: exception: Flavor 42 could not be found. Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: action_args: {'id': '42'} Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:07:24.166135 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:24.167208 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:24.168544 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-bd67614b-c93a-4789-9c0a-6a2117fd6036 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:07:24.169875 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-bd67614b-c93a-4789-9c0a-6a2117fd6036 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015390 Aug 29 20:07:24.169875 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 22/42] 10.222.0.121 () {60 vars in 1195 bytes} [Mon Aug 29 20:07:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:25.136363 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-5cde2986-fbd6-487f-ae9e-9429c2f8be5f admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:25.137364 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-5cde2986-fbd6-487f-ae9e-9429c2f8be5f admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001629 Aug 29 20:07:25.137807 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 21/43] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:25 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:25.664898 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-4f4b077a-9b95-4592-ba17-493eceba983f admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:25.670469 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.wsgi [None req-4f4b077a-9b95-4592-ba17-493eceba983f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-4f4b077a-9b95-4592-ba17-493eceba983f admin admin] Request method failure captured: Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Accept: application/json Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Accept-Encoding: gzip, deflate Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Connection: keep-alive Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Content-Length: 0 Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Host: 10.222.0.121 Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Openstack-Api-Version: compute 2.90 Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Openstack-System-Scope: None Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: User-Agent: python-novaclient Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Auth-Token: gAAAAABjDRx9HWAiZZBO8RYz4XOWMyThPp3Gmle_xmYTlOwBtAdLsHJA_58PKcydHfZwuFpyKYUmr26T-qAnqh7nnh6Mbj5sgLnSGH_y1TF7ihqgOMOPPnS8tQo7tk6edOczn0ZEHzh43eJD4WtXftqjawjpawjGEtWxVzu24rUNUJ1tCaKaBwA Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Domain-Id: None Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Domain-Name: None Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Identity-Status: Confirmed Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Is-Admin-Project: True Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Domain-Id: default Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Domain-Name: Default Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Name: admin Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Role: reader,admin,member Aug 29 20:07:25.672000 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Roles: reader,admin,member Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_94d75b22eada4bbea4e05854ad636ead", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}] Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant: admin Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant-Name: admin Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User: admin Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Domain-Id: default Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Domain-Name: Default Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Id: 2b754541a9ba4f359a8bce9ae9a5b84d Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Name: admin Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: method: > Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: exception: Flavor 84 could not be found. Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: action_args: {'id': '84'} Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:07:25.673513 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:25.674417 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.675521 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-4f4b077a-9b95-4592-ba17-493eceba983f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:07:25.676552 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-4f4b077a-9b95-4592-ba17-493eceba983f admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397538 Aug 29 20:07:25.676552 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 23/44] 10.222.0.121 () {60 vars in 1195 bytes} [Mon Aug 29 20:07:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:25.683491 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-e9e23a50-25ce-40f8-9910-c41c05e8260d admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:25.699145 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-e9e23a50-25ce-40f8-9910-c41c05e8260d admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019736 Aug 29 20:07:25.699684 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 22/45] 10.222.0.121 () {60 vars in 1215 bytes} [Mon Aug 29 20:07:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:07:25.709175 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-8017de9a-8739-428e-b4f1-ff9b8e6e8d1a admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:25.723919 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-8017de9a-8739-428e-b4f1-ff9b8e6e8d1a admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018255 Aug 29 20:07:25.724454 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 24/46] 10.222.0.121 () {60 vars in 1215 bytes} [Mon Aug 29 20:07:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:07:25.733590 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-13b08654-4eaa-4014-9687-880c8cd563c6 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:25.738827 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.wsgi [None req-13b08654-4eaa-4014-9687-880c8cd563c6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-13b08654-4eaa-4014-9687-880c8cd563c6 admin admin] Request method failure captured: Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Accept: application/json Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Accept-Encoding: gzip, deflate Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Connection: keep-alive Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Content-Length: 0 Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Host: 10.222.0.121 Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Openstack-Api-Version: compute 2.90 Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Openstack-System-Scope: None Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: User-Agent: python-novaclient Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Auth-Token: gAAAAABjDRx9HWAiZZBO8RYz4XOWMyThPp3Gmle_xmYTlOwBtAdLsHJA_58PKcydHfZwuFpyKYUmr26T-qAnqh7nnh6Mbj5sgLnSGH_y1TF7ihqgOMOPPnS8tQo7tk6edOczn0ZEHzh43eJD4WtXftqjawjpawjGEtWxVzu24rUNUJ1tCaKaBwA Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Domain-Id: None Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Domain-Name: None Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Identity-Status: Confirmed Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Is-Admin-Project: True Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Domain-Id: default Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Domain-Name: Default Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Name: admin Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Role: reader,admin,member Aug 29 20:07:25.740371 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Roles: reader,admin,member Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_94d75b22eada4bbea4e05854ad636ead", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}] Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant: admin Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant-Name: admin Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User: admin Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Domain-Id: default Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Domain-Name: Default Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Id: 2b754541a9ba4f359a8bce9ae9a5b84d Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Name: admin Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: method: > Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: exception: Flavor 84 could not be found. Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: action_args: {'id': '84'} Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:07:25.741901 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:25.742887 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:25.744367 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-13b08654-4eaa-4014-9687-880c8cd563c6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:07:25.746129 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-13b08654-4eaa-4014-9687-880c8cd563c6 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011661 Aug 29 20:07:25.746129 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 23/47] 10.222.0.121 () {60 vars in 1195 bytes} [Mon Aug 29 20:07:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 20:07:26.750249 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-8017de9a-8739-428e-b4f1-ff9b8e6e8d1a admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:26.751296 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-8017de9a-8739-428e-b4f1-ff9b8e6e8d1a admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001485 Aug 29 20:07:26.751694 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 25/48] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:27.301185 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-bcaf6339-07b4-421f-b314-2284c7fc1e33 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:27.306883 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.wsgi [None req-bcaf6339-07b4-421f-b314-2284c7fc1e33 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-bcaf6339-07b4-421f-b314-2284c7fc1e33 admin admin] Request method failure captured: Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Accept: application/json Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Accept-Encoding: gzip, deflate Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Connection: keep-alive Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Content-Length: 0 Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Host: 10.222.0.121 Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Openstack-Api-Version: compute 2.90 Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Openstack-System-Scope: None Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: User-Agent: python-novaclient Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Auth-Token: gAAAAABjDRx-ztM9EmW6Qvlpydrhgv0DWkDE_vB4hSOzTNeZljBzOAmJpQUEU1oR2Wzozjue38giguDycxL2OcB1e4iJ-GGuDP4X85aNI96V8ZV8_iZuenVkOj0DBI76AwHoZx2BsyC_oGIbKXQuzb_YRkt3X5eVWsLTCL74qIV9CLip7CgqK8o Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Domain-Id: None Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Domain-Name: None Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Identity-Status: Confirmed Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Is-Admin-Project: True Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Domain-Id: default Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Domain-Name: Default Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Project-Name: admin Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Role: reader,admin,member Aug 29 20:07:27.308912 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Roles: reader,admin,member Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_94d75b22eada4bbea4e05854ad636ead", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}] Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant: admin Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-Tenant-Name: admin Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User: admin Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Domain-Id: default Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Domain-Name: Default Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Id: 2b754541a9ba4f359a8bce9ae9a5b84d Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: X-User-Name: admin Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: method: > Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: exception: Flavor 451 could not be found. Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: action_args: {'id': '451'} Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:07:27.310404 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:27.311542 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.312936 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-bcaf6339-07b4-421f-b314-2284c7fc1e33 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:07:27.314499 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-bcaf6339-07b4-421f-b314-2284c7fc1e33 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392458 Aug 29 20:07:27.314499 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 24/49] 10.222.0.121 () {60 vars in 1198 bytes} [Mon Aug 29 20:07:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:27.320075 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-c0b6f8c8-1d85-4761-8877-2300fb1466ee admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:27.335494 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-c0b6f8c8-1d85-4761-8877-2300fb1466ee admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018922 Aug 29 20:07:27.336016 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 26/50] 10.222.0.121 () {60 vars in 1215 bytes} [Mon Aug 29 20:07:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:07:27.345400 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:27.360832 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018996 Aug 29 20:07:27.361364 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 25/51] 10.222.0.121 () {60 vars in 1215 bytes} [Mon Aug 29 20:07:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:07:27.371032 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-dc85e99c-15c0-484d-a5b2-25e2c938604a admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:27.376366 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.wsgi [None req-dc85e99c-15c0-484d-a5b2-25e2c938604a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-dc85e99c-15c0-484d-a5b2-25e2c938604a admin admin] Request method failure captured: Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Accept: application/json Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Accept-Encoding: gzip, deflate Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Connection: keep-alive Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Content-Length: 0 Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Host: 10.222.0.121 Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Openstack-Api-Version: compute 2.90 Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Openstack-System-Scope: None Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: User-Agent: python-novaclient Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Auth-Token: gAAAAABjDRx-ztM9EmW6Qvlpydrhgv0DWkDE_vB4hSOzTNeZljBzOAmJpQUEU1oR2Wzozjue38giguDycxL2OcB1e4iJ-GGuDP4X85aNI96V8ZV8_iZuenVkOj0DBI76AwHoZx2BsyC_oGIbKXQuzb_YRkt3X5eVWsLTCL74qIV9CLip7CgqK8o Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Domain-Id: None Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Domain-Name: None Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Identity-Status: Confirmed Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Is-Admin-Project: True Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Domain-Id: default Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Domain-Name: Default Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Project-Name: admin Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Role: reader,admin,member Aug 29 20:07:27.377850 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Roles: reader,admin,member Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_94d75b22eada4bbea4e05854ad636ead", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/94d75b22eada4bbea4e05854ad636ead"}]}] Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant: admin Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant-Id: 94d75b22eada4bbea4e05854ad636ead Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-Tenant-Name: admin Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User: admin Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Domain-Id: default Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Domain-Name: Default Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Id: 2b754541a9ba4f359a8bce9ae9a5b84d Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: X-User-Name: admin Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: method: > Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: exception: Flavor 451 could not be found. Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: action_args: {'id': '451'} Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:07:27.379397 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:27.381053 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: ERROR nova.api.openstack.wsgi Aug 29 20:07:27.382412 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-dc85e99c-15c0-484d-a5b2-25e2c938604a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:07:27.383922 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-dc85e99c-15c0-484d-a5b2-25e2c938604a admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012290 Aug 29 20:07:27.383922 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 27/52] 10.222.0.121 () {60 vars in 1198 bytes} [Mon Aug 29 20:07:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:28.353493 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:28.354491 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001438 Aug 29 20:07:28.354890 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 26/53] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:28 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:28.890873 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-9fe35bae-02fa-4564-88f3-e4009d5c8ca6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:07:28.910738 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-9fe35bae-02fa-4564-88f3-e4009d5c8ca6 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.417114 Aug 29 20:07:28.911311 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 28/54] 10.222.0.121 () {64 vars in 1240 bytes} [Mon Aug 29 20:07:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:07:29.878088 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:29.879120 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001424 Aug 29 20:07:29.879525 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 27/55] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:29 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:30.415702 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-ddb81474-2d86-43b9-b18e-f4c7a9080c47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:07:30.434093 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-ddb81474-2d86-43b9-b18e-f4c7a9080c47 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404600 Aug 29 20:07:30.434634 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 29/56] 10.222.0.121 () {64 vars in 1240 bytes} [Mon Aug 29 20:07:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:07:31.436354 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:31.437410 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 Aug 29 20:07:31.437804 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 28/57] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:31 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:31.964692 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-035298da-bb6e-49ff-9652-db931e30e296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:07:31.984949 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-035298da-bb6e-49ff-9652-db931e30e296 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409291 Aug 29 20:07:31.985500 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 30/58] 10.222.0.121 () {64 vars in 1240 bytes} [Mon Aug 29 20:07:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:07:32.976216 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:32.977237 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 Aug 29 20:07:32.977629 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 29/59] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:32 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:33.503525 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-37b2cd82-0235-4499-b291-cfab8e379750 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:07:33.522139 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-37b2cd82-0235-4499-b291-cfab8e379750 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.403727 Aug 29 20:07:33.522691 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 31/60] 10.222.0.121 () {64 vars in 1240 bytes} [Mon Aug 29 20:07:33 2022] POST /compute/v2.1/flavors => generated 411 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:07:34.499479 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:34.500488 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001450 Aug 29 20:07:34.500888 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 30/61] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:07:34 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:07:35.024938 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-6ca7209c-7bb9-4db7-bf1f-cbe01c889094 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:07:35.045750 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-6ca7209c-7bb9-4db7-bf1f-cbe01c889094 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.407416 Aug 29 20:07:35.046286 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 32/62] 10.222.0.121 () {60 vars in 1207 bytes} [Mon Aug 29 20:07:34 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:08:28.552600 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:08:28.553594 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-988f0c04-b910-4551-b7f3-2dea98e071a5 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001515 Aug 29 20:08:28.554007 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 31/63] 10.222.0.121 () {54 vars in 936 bytes} [Mon Aug 29 20:08:28 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:08:28.565838 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.961834 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-a73d0638-5b4d-4858-a67f-23ac1eeb6cda admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:08:28.983312 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-a73d0638-5b4d-4858-a67f-23ac1eeb6cda admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.422788 Aug 29 20:08:28.983828 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 33/64] 10.222.0.121 () {60 vars in 1297 bytes} [Mon Aug 29 20:08:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:08:29.004742 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG dbcounter [-] [105713] Writing DB stats nova_api:SELECT=14 {{(pid=105713) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.008575 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-f4507d6e-0eb7-4d83-9125-ad5525db8ed0 admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:08:29.016260 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-f4507d6e-0eb7-4d83-9125-ad5525db8ed0 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012992 Aug 29 20:08:29.016768 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 32/65] 10.222.0.121 () {60 vars in 1288 bytes} [Mon Aug 29 20:08:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:29.028829 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-ac64f2c1-1b17-4055-bf37-279235ac3588 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:08:29.036486 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-ac64f2c1-1b17-4055-bf37-279235ac3588 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011837 Aug 29 20:08:29.036999 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 34/66] 10.222.0.121 () {60 vars in 1291 bytes} [Mon Aug 29 20:08:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:29.048658 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:08:29.056000 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010829 Aug 29 20:08:29.056501 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 33/67] 10.222.0.121 () {60 vars in 1291 bytes} [Mon Aug 29 20:08:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:29.067779 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-49deb5ed-71bf-466e-b4f4-59d301b1209c admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:08:29.075145 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-49deb5ed-71bf-466e-b4f4-59d301b1209c admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010886 Aug 29 20:08:29.075650 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 35/68] 10.222.0.121 () {60 vars in 1288 bytes} [Mon Aug 29 20:08:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:11:33.335468 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:33.336504 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001486 Aug 29 20:11:33.336896 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 34/69] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:11:33 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:11:33.478174 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_api:SELECT=6 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:33.634331 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:33.637828 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:33.638297 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:33.638843 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:33.639564 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:33.640001 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:33.640406 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:33.678160 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-430a78e1-4f89-4913-9093-e875f4c60949 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201805 Aug 29 20:11:33.678719 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 36/70] 10.222.0.121 () {60 vars in 1198 bytes} [Mon Aug 29 20:11:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:34.518790 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:34.519838 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001456 Aug 29 20:11:34.520234 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 35/71] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:11:34 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:11:34.713880 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:34.717268 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:34.717736 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:34.718154 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:34.718863 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:34.719331 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:34.719741 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:34.739377 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-eced9033-1dbf-46e8-8c4a-6f934a88949f admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077329 Aug 29 20:11:34.739925 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 37/72] 10.222.0.121 () {60 vars in 1198 bytes} [Mon Aug 29 20:11:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:45.947358 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:45.948364 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001442 Aug 29 20:11:45.948754 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 36/73] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:11:45 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:11:46.093690 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_cell0:SELECT=4 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:46.094411 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_cell1:SELECT=4 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:46.095021 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG dbcounter [-] [105714] Writing DB stats nova_api:SELECT=8 {{(pid=105714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:46.144585 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:46.147973 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:46.148441 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:46.149543 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:46.150250 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:46.150694 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:46.151131 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:46.175873 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-c3fd0747-9de4-4b6e-9287-82428e6c2828 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086508 Aug 29 20:11:46.176422 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 38/74] 10.222.0.121 () {60 vars in 1198 bytes} [Mon Aug 29 20:11:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:11:47.006366 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: DEBUG nova.api.openstack.wsgi [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] Calling method '>' {{(pid=105713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:47.007425 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: INFO nova.api.openstack.requestlog [None req-cde9bb00-839b-4e5c-9b52-614b22d2dccf admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001424 Aug 29 20:11:47.008345 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: [pid: 105713|app: 0|req: 37/75] 10.222.0.121 () {56 vars in 1079 bytes} [Mon Aug 29 20:11:47 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:11:47.199154 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG nova.api.openstack.wsgi [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] Calling method '>' {{(pid=105714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:11:47.202613 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:47.203114 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:47.203538 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:47.204253 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:11:47.204692 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:11:47.205101 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: DEBUG oslo_concurrency.lockutils [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:11:47.227895 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: INFO nova.api.openstack.requestlog [None req-dfae65e9-15eb-4ff0-b50a-d1da779804bf admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080210 Aug 29 20:11:47.228442 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: [pid: 105714|app: 0|req: 39/76] 10.222.0.121 () {60 vars in 1198 bytes} [Mon Aug 29 20:11:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:12:47.679006 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: Mon Aug 29 20:12:47 2022 - graceful shutdown triggered... Aug 29 20:12:47.679168 dv-cinder-854262-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 20:12:47.680138 dv-cinder-854262-2-iscsi devstack@n-api.service[105713]: Gracefully killing worker 1 (pid: 105713)... Aug 29 20:12:47.680563 dv-cinder-854262-2-iscsi devstack@n-api.service[105714]: Gracefully killing worker 2 (pid: 105714)... Aug 29 20:12:48.680584 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: worker 1 buried after 1 seconds Aug 29 20:12:48.681140 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: worker 2 buried after 1 seconds Aug 29 20:12:48.681140 dv-cinder-854262-2-iscsi devstack@n-api.service[105712]: goodbye to uWSGI. Aug 29 20:12:48.682349 dv-cinder-854262-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 20:12:48.682895 dv-cinder-854262-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 20:12:48.685744 dv-cinder-854262-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:12:48.694912 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:12:48 2022] *** Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: nodename: dv-cinder-854262-2-iscsi Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: machine: x86_64 Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: clock source: unix Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: pcre jit disabled Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: detected number of CPU cores: 4 Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: current working directory: / Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:12:48.697679 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: your processes number limit is 47680 Aug 29 20:12:48.698397 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: your memory page size is 4096 bytes Aug 29 20:12:48.698397 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: detected max file descriptor number: 2048 Aug 29 20:12:48.698397 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: lock engine: pthread robust mutexes Aug 29 20:12:48.698397 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: thunder lock: enabled Aug 29 20:12:48.698397 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:12:48.698397 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:12:48.738498 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: Python main interpreter initialized at 0x5559ab1f49c0 Aug 29 20:12:48.738498 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: python threads support enabled Aug 29 20:12:48.738498 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: your server socket listen backlog is limited to 100 connections Aug 29 20:12:48.738498 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:12:48.738928 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:12:48.738928 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: *** Operational MODE: preforking *** Aug 29 20:12:48.739256 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:12:48.739256 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: spawned uWSGI master process (pid: 120701) Aug 29 20:12:48.741623 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: spawned uWSGI worker 1 (pid: 120720, cores: 1) Aug 29 20:12:48.741623 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: spawned uWSGI worker 2 (pid: 120721, cores: 1) Aug 29 20:12:48.741623 dv-cinder-854262-2-iscsi devstack@n-api.service[120701]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:12:48.739457 dv-cinder-854262-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:12:49.401890 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:12:49.402544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:12:50.562223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:12:50.562223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Aug 29 20:12:50.562971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:12:50.562971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Aug 29 20:12:50.575706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:12:50.575706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: from cryptography.utils import int_from_bytes Aug 29 20:12:50.576164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:12:50.576164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: from cryptography.utils import int_from_bytes Aug 29 20:12:53.019320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:12:53.019955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:12:53.020131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:12:53.020486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:12:53.020759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:12:53.021143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.021473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.021803 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.022123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.022615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.022930 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.023285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.023615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.023959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.024225 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.024589 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.024924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-2-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.025254 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.025683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.025969 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.026297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.026609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.026939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.027336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.027803 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.029270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.029270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.029270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.029270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.029601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.029833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.030102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.030409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.030740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.031051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.031493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-2-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.031833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.032148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.032474 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.032893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.033211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.033536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.033859 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.034189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.034502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.034823 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.035170 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.035510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.035813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.036118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.036430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.037618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.037618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.037618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.037618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.037971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.038173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.038485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.038810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.039157 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.039416 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.039669 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.039987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.040872 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.041193 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.041505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.041820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.042129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.042446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.043658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.043658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.043658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.044119 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.044119 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.044429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.044650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.044976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.045385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.045634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.045943 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.046292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.046617 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.046929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.047139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:12:53.047599 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.047806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:12:53.047967 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.047967 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.048249 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:12:53.048393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.048548 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:12:53.048693 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.048837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:12:53.048987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.049159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.049334 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.049487 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.049638 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.049807 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.049957 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.050108 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.050262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.050262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.050554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.050699 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.050848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.050999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.051221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.051393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.051545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.051689 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.051864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.051864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.052159 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.052303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.052480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.052480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.052767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-2-iscsi {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.052923 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.053068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.053645 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.053815 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.054207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.054364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.054527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.054682 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.054836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.055000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.055204 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.055765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.056866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.056976 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057449 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.057894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058186 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058288 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058380 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058801 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.058983 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059216 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-2-iscsi {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059582 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059673 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.059900 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.060042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.060214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.060349 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.060633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.060734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.060945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.061047 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.061255 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.061355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.061558 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.061649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.061866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.061958 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.062171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.062262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.062472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.062572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.062778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.062878 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.063110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.063216 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.063491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.063643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.063741 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.063834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.064008 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.064157 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.064312 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.064419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.064629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.064721 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.064928 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.065027 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.065235 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.065413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.065685 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.065795 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.065890 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.065975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.066068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.066209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.066371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.066557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.066690 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.066876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.066981 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.067201 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.067298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.067521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.067624 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.067840 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.067949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.068145 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.068245 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.068450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.068543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.068753 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.068847 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.069056 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.069149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.069358 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.069449 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.069661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.069762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.069965 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.070068 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.070269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.070371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.070586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.070679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.070898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.070999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.071237 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.071383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.071570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.071669 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.071889 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.071980 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.072213 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.072422 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.072549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.072676 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.072876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.072969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.073191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.073292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.073557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.073751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.073901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.074024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.074295 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.074391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.074509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.074649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.074832 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.074957 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.075169 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.075279 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.075484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.075584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.075799 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.075905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.076121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.076259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.076505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.076606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.076753 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.076876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.077077 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.077160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.077390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.077479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.077725 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.077807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.078044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.078145 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.078360 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.078443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.078668 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.078781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.079018 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.079164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.079296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.079390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.079601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.079698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.079909 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.079998 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.080215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.080306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.080522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.080613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.080824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.080913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.081129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.081217 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.081432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.081527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.081735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.081825 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.082043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.082123 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.082352 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.082435 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.082652 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.082733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.082954 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.083049 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.083281 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.083373 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.083894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.084014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.084014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.084242 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.084346 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.084431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.084515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.084597 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.084881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.084992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.085172 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.085266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.085506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.085612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.085882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.085989 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.086130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.086265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.086497 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.086607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.086788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.087462 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.087669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.087771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.088002 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.088127 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.088374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.088453 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.088666 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.088789 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.088946 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.089040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.089251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.089343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.089556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.089654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.089860 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.089959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.090163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.090260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.090464 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.090553 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.090765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.090868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.091063 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.091211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.091399 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.091500 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.091756 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.091865 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.092031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.092120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.092336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.092426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.092640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.092742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.092958 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:12:53.093049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.093284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.093379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.093609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.093706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.093936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.094046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.094255 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.094363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.094559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.094735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.094894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.095066 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.095193 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.095289 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.095491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.095593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.095799 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.095892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.096116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.096237 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.096421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.096515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.096726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.096826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.097029 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.097135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.097334 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.097425 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.097639 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.097732 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.097967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.098073 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.098277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.098391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.098582 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.098684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.098889 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.099002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.099220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.099320 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.099534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.099625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.099862 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.099953 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.100181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.100279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.100492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.100583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.100833 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.100932 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.101157 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.101254 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.101479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.101635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.101799 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.101951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.102099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.102253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.102405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.103229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.103345 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.103431 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.103585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.103766 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.103920 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.104110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.104261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.104413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.104531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.104713 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.104819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.105028 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.105123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.105342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.105442 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.105696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.105791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.106043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.106265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.106381 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.106769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.107126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.107231 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.107452 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.107542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.107772 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.107859 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.108084 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.108163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.108402 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.108501 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.108718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.108807 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.109033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.109129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.109345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.109427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.109654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.109742 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.110803 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.110913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.110999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111210 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111305 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111582 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111673 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.111930 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.112023 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.112107 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.112197 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.112394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.112494 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.112726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.112819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.113063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.113155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.113366 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.113458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.113676 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.113775 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.113990 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.114082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.114297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.114396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.114603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.114701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.114911 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.115004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.115261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.115405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.115579 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.115685 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.115977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.116104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.116491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.116603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.116717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.116798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.116885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.116968 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.117148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.117265 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.117464 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.117563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.117814 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.117914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.118121 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.118260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.118449 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.118555 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.118760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.118858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.119278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.119499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.119602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.119695 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.119830 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.119929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.120157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.120257 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.120471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.120684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.120775 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.120856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.121105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.121207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.121437 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.121531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.121742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.121838 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.122054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.122153 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.122364 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.122454 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.122675 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.122764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.122979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.123097 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.123316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.123406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.123621 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.123729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.123926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.124017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.124232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.124322 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.124541 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.124654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.124846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.124963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.125146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.125273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.125448 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.125610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.125749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.125840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.126062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.126170 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.126357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.126452 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.126660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.126750 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.126961 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.127051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.127293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.127386 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.127603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.127693 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.127908 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.128003 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.128222 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.128313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.128536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.128633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.128842 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.128939 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.129155 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.129253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.129473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.129564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.129790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.130054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.130157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.130392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.130481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.130696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.130792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.131010 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.131321 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.131488 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.131645 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.131808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.131969 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.132139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.132305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.132459 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.132609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.132774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.132933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.133084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.133234 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.133402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.133561 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.133728 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.133945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.134180 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.134432 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.134669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.134936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.134936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.135442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.135598 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.135749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.136080 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.137360 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.137531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.137692 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.137853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.138025 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.138232 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.138405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.138620 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.138780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.138933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.139161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.139323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.139505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.139659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.139810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.139969 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.140121 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.140281 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.140433 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.140583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.140741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.140902 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.141063 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.141244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.141493 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.141662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.141821 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.141973 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.142124 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.142285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.142437 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.142596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.142755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.142854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.142945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143274 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143771 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.143981 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144314 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144490 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144580 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.144945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145017 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145163 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145358 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.145979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146376 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146503 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146805 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.146978 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.147376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.147523 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.147615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.147768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.147857 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.147982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.148111 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.148303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.148463 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.148614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.148773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.148920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.149096 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.149225 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.149911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.150354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.150464 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.150550 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.150630 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.150866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.150959 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.151225 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.151359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.151560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.151652 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.151931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.152054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.152269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.152361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.152612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.152709 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.152923 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.153013 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.153268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.153366 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.153598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.153704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.153901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.154003 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.154213 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.154303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.154517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.154613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.154828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.154927 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.155166 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.155288 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.155464 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.155577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.155769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.155899 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.156077 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.156259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.156413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.156576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.156798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.156964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.156964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.157284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.157284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.157745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.157745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.158038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.158200 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.158349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.158501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.158649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.158820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.158820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.159103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.159242 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.159396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.159550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.159700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.159841 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.159991 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.160144 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.160291 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.160443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.160598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.160746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.160888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.161050 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.161192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.161340 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.161482 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.161623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.161776 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.161921 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.162082 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.162232 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.162374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.162374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.162730 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.162883 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.163033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.163208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.163353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.163503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.163655 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.163796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.163956 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.164106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.164255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.164403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.164554 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.164706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.164873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.165706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.165857 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.165958 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166422 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166422 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.166981 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.167229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.167341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.167712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.167836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.167933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.168019 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.168157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.168249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.168465 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.168569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.168776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.168874 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.169093 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.169244 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.169409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.169517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.169724 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.169824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.170036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.170128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.170348 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.170443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.170664 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.170757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.170976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.171068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.171310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.171414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.171617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.171720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.171949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.172049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.172285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.172382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.172619 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.172764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.172944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.173066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.173256 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.173378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.173581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.173710 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.173891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.174028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.174199 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.174343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.174501 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.174650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.174966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.175139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.175292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.175409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.175533 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.175655 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.175766 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.175891 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.176011 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.176192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.176312 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.176501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.176622 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.177014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.177321 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.177632 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.177946 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.178055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.178261 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.178357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.178567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.178668 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.178872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.178964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.179292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.179425 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.179615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.179726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.179932 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.180030 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.180243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.180412 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.180576 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.180698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.180945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.181049 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.181258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.181351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182093 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182241 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182334 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182544 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182849 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.182982 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.183184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.183332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.183508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.183649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.183825 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.184080 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.184182 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.184403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.184505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.184705 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.184804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.185008 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.185110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.185310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.185405 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.185614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.185716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.185916 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.186022 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.186217 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.186318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.186517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.186610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.186818 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.186924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.187140 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.187255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.187461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.187555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.187774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.187899 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.188159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.188254 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.188363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.188465 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.188663 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.188771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.189004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.189104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.189306 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.189400 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.189660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.189798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.189963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.190132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.190278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.190451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.190594 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.190781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.190904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.191133 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.191240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.191448 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.191550 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.191759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.191852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.192074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.192214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.192385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.192493 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.192697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.192790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.192994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.193085 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.193297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.193394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.193617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.193710 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.193925 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.194019 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.194234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.194336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.194538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.194630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.194846 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.194940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.195195 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.195293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.195501 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.195594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.195808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.195900 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.196119 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.196220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.196475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.196595 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.196805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.196913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.197120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.197263 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.197462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.197572 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.197785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.197915 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.198096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.198222 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.198411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.198574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.198714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.198816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.199019 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.199139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.199384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.199686 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.199789 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.200000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.200155 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.200309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.200495 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.200636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.200813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.200947 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.201191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.201393 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.201538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.201714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.201867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.202223 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.202317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.202398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.202512 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.202829 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.203196 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.203403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.203548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.203813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.203947 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.204126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.204248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.204440 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.204560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.204756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.204886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.205067 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.205196 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.205378 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.205504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.205688 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.205817 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.206000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.206137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.206297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.206388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.206625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.206733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.206940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.207034 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211130 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211255 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211433 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211660 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211730 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.211813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.212458 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.212551 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.212631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.212712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.212785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.212872 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.212945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213153 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213328 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213406 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.213949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214019 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214096 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214179 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214329 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214408 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214478 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214708 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.214926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215009 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215196 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.215842 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.216079 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.216185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.216413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.216510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.216720 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.216816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.217039 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.217134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.217370 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.217479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.217673 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.217780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.217998 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.218123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.218323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.218434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.218672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.218771 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.219277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.219395 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.219472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.219553 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.219736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.219832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.219972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.220079 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.220555 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.220672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.220749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.220820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.220892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.220963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.221163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.221265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.221450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.221549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.222469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.222588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.222678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.222752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.222830 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.222902 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.222980 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223058 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223362 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223448 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223592 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223664 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223748 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.223821 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.224107 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.224205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.224287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.224445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.224606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.224752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.224904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.225071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.225242 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.225400 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.225559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.225706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.225986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.226090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.226287 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.226396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.226591 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.226695 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.226893 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.227162 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.227261 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.228284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.228390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.228474 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.228546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.228757 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.228964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.229129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.229220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.229442 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.229554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.229733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.229824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.230046 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.230145 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.230364 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.230461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.230662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.230771 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.230974 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.231071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.231313 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.231410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.231625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.231731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.232054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.232156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.232347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.232442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.232635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.232736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.232915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.233006 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.233414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.233516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.233600 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.233825 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.233919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.234095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.234185 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.234373 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.234478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.234661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.234752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.234967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.235071 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.235339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.235436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.235655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.235746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.235918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.236150 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.236247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.236474 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.236580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.236787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.236884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.237112 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.237215 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.237422 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.237527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.237788 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.237887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.238071 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.238172 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.238438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.238539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.238717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.238824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.239004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.239128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.239310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.239502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.239607 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.239689 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.239905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.240005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.240192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.240290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.240497 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.240608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.240811 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.240920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.241121 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.241223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.241424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.241675 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.241785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.242010 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.242139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.242452 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.242558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.242634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.242714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.242955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.243045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.243285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.243408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.243799 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.243909 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.243909 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.244049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.244289 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.244380 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.244580 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.244687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.244935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.245092 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.245239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.245392 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.245553 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.245709 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.245858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.246014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.246198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.246386 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.246612 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.246770 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.246918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.247071 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.247262 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.247420 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.247582 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.247737 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.247975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.248136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.248291 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.248484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.248707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.248707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.249044 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.249200 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.249354 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.249556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.249855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.250013 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.250164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.250321 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.250471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.251252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.251429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.251581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.251729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.251877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.252034 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.252184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.252366 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.252681 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.252831 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.252979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.253136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.253293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.253461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.253636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.254095 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.254258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.254417 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.254567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.254714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.254860 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.255007 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.255217 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.255378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.255378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.255678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.255835 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.255982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.256141 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.256297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.256446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.256601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.256932 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.257100 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.257259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.257409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.257564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.257719 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.257886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.258130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.258300 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.258457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.258613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.258868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.259023 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.259220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.259220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.259507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.259507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.259875 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.260133 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.260399 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.260399 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.260862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.261120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.261120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.261483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.261646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.261797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.261797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.262090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.262238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.262238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.262725 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.262725 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.263032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.263311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.263473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.263631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.263781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.264046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.264380 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.264530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.264688 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.264847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.265015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.265164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.265318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.265475 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.265637 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.265788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.265936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.266083 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.266237 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.266385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.266541 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.266689 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.266836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.267007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.267189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.267338 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.267501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.267650 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.267796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.267951 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.268126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.268359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.268523 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.268680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.268853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.269080 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.269255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.269419 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.269575 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.269769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.269931 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.270095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.270257 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.270419 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.270576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.270723 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.270870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.271024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.271208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.271370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.271526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.271682 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.271838 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.271994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.272143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.272299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.272454 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.272601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.272914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.273079 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.273243 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.273411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.273560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.273708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.273863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.274036 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.274954 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.275167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.275325 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.275515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.275760 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.275944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.276105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.276255 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.276415 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.276562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.276709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.276856 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.277017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.277167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.277315 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.277462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.277616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.277783 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.277932 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.278087 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.278235 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.278235 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.278624 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.278783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.278932 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.279110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.279461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.279633 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.279828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.280067 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.280067 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.280359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.280359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.280681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.280838 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.280999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.281147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.281448 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.281626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.281953 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.282210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.282388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.282580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.282783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.283424 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.283647 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.283867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.284063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.284246 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.284683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.284902 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.285163 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.285336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.285494 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.285642 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.285797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.285952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.286109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.286269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.286425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.286574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.286729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.286877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.287033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.287220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.287370 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.287517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.287672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.287672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.287964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.288131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.288288 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.288459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.288684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.288854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.288854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.289145 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.289313 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.289546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.289701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.289909 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.290186 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.290862 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.291034 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.291262 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.291422 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.291581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.291738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.291920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.292125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.292276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.292433 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.292589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.292589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.292874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.293040 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.293196 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.293576 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.293734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.293882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.294029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.294192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.294349 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.294627 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.294919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.295093 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.295382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.295548 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.295719 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.295869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.296164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.297273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.298409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.300004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.301162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.301162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.301162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.301162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.302384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.302384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.302384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.302384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.302384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.303282 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.303282 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.303875 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.303875 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.304167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.304363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.304678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.304985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.305295 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.305595 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.305962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.306283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.306841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.307189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.307509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.307829 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.308151 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.308462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.308790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.309105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.309412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.309720 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.310057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.310339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.310652 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.310961 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.311297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.311613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.311925 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.312251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.312576 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.312885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.313207 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.313532 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.313989 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.314308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.314654 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.314982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.315319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.315678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.315925 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:12:53.316166 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:12:53.351964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Registered counter for database nova_api Aug 29 20:12:53.373489 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.378554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO dbcounter [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Registered counter for database nova_api Aug 29 20:12:53.380512 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.399045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_db.sqlalchemy.engines [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.406282 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writer thread running {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.438346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.context [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05f1666c-b639-455a-b175-1a63fa7e82b0(cell1) {{(pid=120720) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:12:53.442415 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.442895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.444569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.445293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.445741 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.448292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.450292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Registered counter for database nova_cell0 Aug 29 20:12:53.454314 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Registered counter for database nova_cell1 Aug 29 20:12:53.462581 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.463537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.464492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.context [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05f1666c-b639-455a-b175-1a63fa7e82b0(cell1) {{(pid=120721) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:12:53.468575 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.469054 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.470210 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.470608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.471353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:12:53.471796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:12:53.473766 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:12:53.475266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.475763 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO dbcounter [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Registered counter for database nova_cell0 Aug 29 20:12:53.479951 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO dbcounter [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Registered counter for database nova_cell1 Aug 29 20:12:53.487043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_db.sqlalchemy.engines [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.488774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_db.sqlalchemy.engines [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.494866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writer thread running {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.496490 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writer thread running {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.619959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Registered counter for database nova_cell0 Aug 29 20:12:53.626483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.630981 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.642887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO dbcounter [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Registered counter for database nova_cell0 Aug 29 20:12:53.652222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_db.sqlalchemy.engines [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:12:53.656675 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writer thread running {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:12:53.958065 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:12:53.966135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:12:53.981651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: WARNING keystonemiddleware.auth_token [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:12:53.988897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: WARNING keystonemiddleware.auth_token [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:12:54.320513 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:12:54.327874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-f62c8841-ea75-48ec-8e53-9e15a58ffb8f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:12:54.333227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559ab1f49c0 pid: 120720 (default app) Aug 29 20:12:54.343522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: WARNING keystonemiddleware.auth_token [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:12:54.349474 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: WARNING keystonemiddleware.auth_token [None req-d93529f1-a63c-4818-8c91-585688a9fd63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:12:54.354813 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559ab1f49c0 pid: 120721 (default app) Aug 29 20:13:30.022012 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:30.023225 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:30.024131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:30.025182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:30.990376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f565b077-7198-4041-9b7f-b3366dd18ee3 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Action: 'create', calling method: .version_select at 0x7f446a478e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-285017840"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:31.304215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:31.309475 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:31.311511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:31.313926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:32.850877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-125c191b-e444-4754-b00b-edac11ec5c58 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Action: 'create', calling method: .version_select at 0x7f446a476e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-590810525", "metadata": {"Type": "work"}}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-125c191b-e444-4754-b00b-edac11ec5c58 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Request method failure captured: Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 121 Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3ru-kWaYS0J8n5scKTg6TNe1me1qceyoVJQ9Q4cH-7S-TR4JWBTlHiZ9EqDde4ix0_cWQVORqCpMdw6anUS7sNrPv767GA60j-RyFVa7kDLWBqakQgxtd9PUenlxbS2RXG-_u0j_J-cEyHl9xUuS7sIon4n1GVgcD8J4-LiCQIRLw Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:13:32.858574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_8904082d21e64aa299864e14ebdf6875", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}] Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 6caeb1cdf37a457b89825878df351759 Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-590810525", "metadata": {"Type": "work"}}} Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: Aug 29 20:13:32.860271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-590810525', 'metadata': {'Type': 'work'}}}} Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:32.861236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:13:32.862879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:13:32.864414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:13:32.864414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.865612 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-125c191b-e444-4754-b00b-edac11ec5c58 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:32.866799 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-125c191b-e444-4754-b00b-edac11ec5c58 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.576449 Aug 29 20:13:32.867563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 1/1] 10.222.0.121 () {60 vars in 1161 bytes} [Mon Aug 29 20:13:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:13:32.878551 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-58387aa5-9431-4d14-886c-3aff3fac8c3d tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Action: 'create', calling method: .version_select at 0x7f446a3c0940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1840752640", "metadata": {"Type": "work"}}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-58387aa5-9431-4d14-886c-3aff3fac8c3d tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Request method failure captured: Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 120 Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3ru-kWaYS0J8n5scKTg6TNe1me1qceyoVJQ9Q4cH-7S-TR4JWBTlHiZ9EqDde4ix0_cWQVORqCpMdw6anUS7sNrPv767GA60j-RyFVa7kDLWBqakQgxtd9PUenlxbS2RXG-_u0j_J-cEyHl9xUuS7sIon4n1GVgcD8J4-LiCQIRLw Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:13:32.883782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_8904082d21e64aa299864e14ebdf6875", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}] Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 6caeb1cdf37a457b89825878df351759 Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1840752640", "metadata": {"Type": "work"}}} Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: Aug 29 20:13:32.886434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1840752640', 'metadata': {'Type': 'work'}}}} Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi '0' Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:32.887423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:13:32.889141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:13:32.891533 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:13:32.891533 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.891533 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-58387aa5-9431-4d14-886c-3aff3fac8c3d tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:32.893135 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-58387aa5-9431-4d14-886c-3aff3fac8c3d tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019308 Aug 29 20:13:32.894169 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 2/2] 10.222.0.121 () {60 vars in 1161 bytes} [Mon Aug 29 20:13:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:13:32.916084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-783fc17c-13d5-4802-b185-7a55d3080816 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Action: 'create', calling method: .version_select at 0x7f446a323a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1533360786", "metadata": {"Type": "work"}}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-783fc17c-13d5-4802-b185-7a55d3080816 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Request method failure captured: Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 119 Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3ru-kWaYS0J8n5scKTg6TNe1me1qceyoVJQ9Q4cH-7S-TR4JWBTlHiZ9EqDde4ix0_cWQVORqCpMdw6anUS7sNrPv767GA60j-RyFVa7kDLWBqakQgxtd9PUenlxbS2RXG-_u0j_J-cEyHl9xUuS7sIon4n1GVgcD8J4-LiCQIRLw Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:13:32.920044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_8904082d21e64aa299864e14ebdf6875", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}] Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 6caeb1cdf37a457b89825878df351759 Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1533360786", "metadata": {"Type": "work"}}} Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: Aug 29 20:13:32.921421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1533360786', 'metadata': {'Type': 'work'}}}} Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi '' Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:32.922206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:13:32.928970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:13:32.930120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:13:32.930120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:32.930120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-783fc17c-13d5-4802-b185-7a55d3080816 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:32.930120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-783fc17c-13d5-4802-b185-7a55d3080816 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022025 Aug 29 20:13:32.930120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 3/3] 10.222.0.121 () {60 vars in 1161 bytes} [Mon Aug 29 20:13:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:13:32.943456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d8e44229-61da-41c5-9438-67072edc2777 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Calling method '.version_select at 0x7f446a323700>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:33.210388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f565b077-7198-4041-9b7f-b3366dd18ee3 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.202555 Aug 29 20:13:33.211456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1/4] 10.222.0.121 () {60 vars in 1160 bytes} [Mon Aug 29 20:13:30 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3206 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 29 20:13:33.228011 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-012d753f-620e-4355-95de-c8c345da3235 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a2ffca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:33.335678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-012d753f-620e-4355-95de-c8c345da3235 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870" status: 200 len: 344 microversion: 2.1 time: 0.113912 Aug 29 20:13:33.336251 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2/5] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:13:33 2022] GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:13:33.787329 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-d8e44229-61da-41c5-9438-67072edc2777 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] HTTP exception thrown: Volume tempest-invalid-249322129 could not be found. Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d8e44229-61da-41c5-9438-67072edc2777 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Request method failure captured: Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-249322129 HTTP/1.1 Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3ru-kWaYS0J8n5scKTg6TNe1me1qceyoVJQ9Q4cH-7S-TR4JWBTlHiZ9EqDde4ix0_cWQVORqCpMdw6anUS7sNrPv767GA60j-RyFVa7kDLWBqakQgxtd9PUenlxbS2RXG-_u0j_J-cEyHl9xUuS7sIon4n1GVgcD8J4-LiCQIRLw Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:13:33.791405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_8904082d21e64aa299864e14ebdf6875", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}] Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 6caeb1cdf37a457b89825878df351759 Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Volume tempest-invalid-249322129 could not be found. Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': 'tempest-invalid-249322129'} Aug 29 20:13:33.792717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-249322129 could not be found. (HTTP 404) (Request-ID: req-23c96f15-b307-4304-aa68-83dcbafc5e88) Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.793521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:13:33.794648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-249322129 could not be found. Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:13:33.795795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-249322129 could not be found. Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-249322129 could not be found. Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d8e44229-61da-41c5-9438-67072edc2777 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Returning 404 to user: Volume tempest-invalid-249322129 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d8e44229-61da-41c5-9438-67072edc2777 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/tempest-invalid-249322129" status: 404 len: 98 microversion: 2.1 time: 0.860077 Aug 29 20:13:33.800886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 4/6] 10.222.0.121 () {58 vars in 1220 bytes} [Mon Aug 29 20:13:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-249322129 => generated 98 bytes in 867 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:13:33.806842 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e566a85-18e0-4514-a647-1c8af5738878 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004783 Aug 29 20:13:33.808538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3/7] 10.222.0.121 () {58 vars in 1145 bytes} [Mon Aug 29 20:13:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 20:13:33.817796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1d664d7c-5255-417d-b28f-79a35941cb0c tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007076 Aug 29 20:13:33.818574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 5/8] 10.222.0.121 () {58 vars in 1142 bytes} [Mon Aug 29 20:13:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 29 20:13:33.831554 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc7bf701-a9f8-4c71-898a-fe636ead7dbe tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Calling method '.version_select at 0x7f446a3135e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:33.880127 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bc7bf701-a9f8-4c71-898a-fe636ead7dbe tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] HTTP exception thrown: Volume 7c77d18e-627a-4a5c-8de9-a7adfbda314c could not be found. Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc7bf701-a9f8-4c71-898a-fe636ead7dbe tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Request method failure captured: Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-volumes/7c77d18e-627a-4a5c-8de9-a7adfbda314c HTTP/1.1 Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR3ru-kWaYS0J8n5scKTg6TNe1me1qceyoVJQ9Q4cH-7S-TR4JWBTlHiZ9EqDde4ix0_cWQVORqCpMdw6anUS7sNrPv767GA60j-RyFVa7kDLWBqakQgxtd9PUenlxbS2RXG-_u0j_J-cEyHl9xUuS7sIon4n1GVgcD8J4-LiCQIRLw Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:13:33.887606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_8904082d21e64aa299864e14ebdf6875", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}] Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 6caeb1cdf37a457b89825878df351759 Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Volume 7c77d18e-627a-4a5c-8de9-a7adfbda314c could not be found. Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '7c77d18e-627a-4a5c-8de9-a7adfbda314c'} Aug 29 20:13:33.889100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c77d18e-627a-4a5c-8de9-a7adfbda314c could not be found. (HTTP 404) (Request-ID: req-fc66dc6c-1aad-4d8a-b0fa-875a0cd7d049) Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.890052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:13:33.892305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c77d18e-627a-4a5c-8de9-a7adfbda314c could not be found. Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:13:33.893765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c77d18e-627a-4a5c-8de9-a7adfbda314c could not be found. Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c77d18e-627a-4a5c-8de9-a7adfbda314c could not be found. Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc7bf701-a9f8-4c71-898a-fe636ead7dbe tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Returning 404 to user: Volume 7c77d18e-627a-4a5c-8de9-a7adfbda314c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc7bf701-a9f8-4c71-898a-fe636ead7dbe tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/7c77d18e-627a-4a5c-8de9-a7adfbda314c" status: 404 len: 109 microversion: 2.1 time: 0.065325 Aug 29 20:13:33.895198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4/9] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:13:33 2022] DELETE /compute/v2.1/os-volumes/7c77d18e-627a-4a5c-8de9-a7adfbda314c => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:13:33.910025 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5c9dd214-d453-4857-946b-a60c637d15b8 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Calling method '.version_select at 0x7f446a289af0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:33.975322 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-5c9dd214-d453-4857-946b-a60c637d15b8 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] HTTP exception thrown: Volume 17b420ae-364f-4b96-b011-582a3b8258cb could not be found. Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5c9dd214-d453-4857-946b-a60c637d15b8 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Request method failure captured: Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/os-volumes/17b420ae-364f-4b96-b011-582a3b8258cb HTTP/1.1 Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3ru-kWaYS0J8n5scKTg6TNe1me1qceyoVJQ9Q4cH-7S-TR4JWBTlHiZ9EqDde4ix0_cWQVORqCpMdw6anUS7sNrPv767GA60j-RyFVa7kDLWBqakQgxtd9PUenlxbS2RXG-_u0j_J-cEyHl9xUuS7sIon4n1GVgcD8J4-LiCQIRLw Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:13:33.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_8904082d21e64aa299864e14ebdf6875", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/8904082d21e64aa299864e14ebdf6875"}]}] Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 8904082d21e64aa299864e14ebdf6875 Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-VolumesNegativeTest-227822826 Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 6caeb1cdf37a457b89825878df351759 Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-VolumesNegativeTest-227822826-project Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Volume 17b420ae-364f-4b96-b011-582a3b8258cb could not be found. Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '17b420ae-364f-4b96-b011-582a3b8258cb'} Aug 29 20:13:33.979155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17b420ae-364f-4b96-b011-582a3b8258cb could not be found. (HTTP 404) (Request-ID: req-c86d035f-1980-41e7-b757-18b0512e1716) Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.979938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:33.981068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17b420ae-364f-4b96-b011-582a3b8258cb could not be found. Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:13:33.982176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17b420ae-364f-4b96-b011-582a3b8258cb could not be found. Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17b420ae-364f-4b96-b011-582a3b8258cb could not be found. Aug 29 20:13:33.983250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:33.985096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5c9dd214-d453-4857-946b-a60c637d15b8 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] Returning 404 to user: Volume 17b420ae-364f-4b96-b011-582a3b8258cb could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:33.986754 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5c9dd214-d453-4857-946b-a60c637d15b8 tempest-VolumesNegativeTest-227822826 tempest-VolumesNegativeTest-227822826-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/17b420ae-364f-4b96-b011-582a3b8258cb" status: 404 len: 109 microversion: 2.1 time: 0.080277 Aug 29 20:13:33.987749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 6/10] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:13:33 2022] GET /compute/v2.1/os-volumes/17b420ae-364f-4b96-b011-582a3b8258cb => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:13:34.369050 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55df33fe-4433-4a9c-a4ca-2907c7b61b57 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a27f430>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:34.530298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55df33fe-4433-4a9c-a4ca-2907c7b61b57 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870" status: 200 len: 345 microversion: 2.1 time: 0.180003 Aug 29 20:13:34.545536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 5/11] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:13:34 2022] GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:34.549765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4cb97e77-ef36-45b9-9a1b-de1e430738f6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Action: 'create', calling method: .version_select at 0x7f446a289b80>, body: {"snapshot": {"volume_id": "0cccf676-d2c6-42ec-893e-55ddd7212870", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1459910858"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:35.143946 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4cb97e77-ef36-45b9-9a1b-de1e430738f6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.599930 Aug 29 20:13:35.144498 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 7/12] 10.222.0.121 () {60 vars in 1167 bytes} [Mon Aug 29 20:13:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:35.158349 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db441716-462d-4f46-bd9f-7645e2008b97 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a27faf0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:35.272347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db441716-462d-4f46-bd9f-7645e2008b97 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 200 len: 287 microversion: 2.1 time: 0.117954 Aug 29 20:13:35.283619 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d9b901eb-7a9f-4c66-9f96-a4f8d3587df1 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a222a60>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:35.289196 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 6/13] 10.222.0.121 () {58 vars in 1256 bytes} [Mon Aug 29 20:13:35 2022] GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:35.362645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d9b901eb-7a9f-4c66-9f96-a4f8d3587df1 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.082661 Aug 29 20:13:35.363626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 8/14] 10.222.0.121 () {58 vars in 1145 bytes} [Mon Aug 29 20:13:35 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:13:35.376559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-943f5fa9-aa91-4253-81b2-067c88e78d64 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a27fa60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:35.433871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-943f5fa9-aa91-4253-81b2-067c88e78d64 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 200 len: 287 microversion: 2.1 time: 0.062155 Aug 29 20:13:35.435047 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 7/15] 10.222.0.121 () {58 vars in 1256 bytes} [Mon Aug 29 20:13:35 2022] GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:36.448189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-98287a68-3678-4793-b79a-3e304f3f5c3a tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a2895e0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:36.534993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-98287a68-3678-4793-b79a-3e304f3f5c3a tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 200 len: 287 microversion: 2.1 time: 0.090737 Aug 29 20:13:36.541608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 9/16] 10.222.0.121 () {58 vars in 1256 bytes} [Mon Aug 29 20:13:36 2022] GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:37.552701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40ab7def-94b7-454f-b646-e6e788cc0ea9 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a27f3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:37.621678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40ab7def-94b7-454f-b646-e6e788cc0ea9 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 200 len: 287 microversion: 2.1 time: 0.074450 Aug 29 20:13:37.622822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 8/17] 10.222.0.121 () {58 vars in 1256 bytes} [Mon Aug 29 20:13:37 2022] GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:38.648320 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7a60abe1-0024-4be2-b904-6552cea0ffa9 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a289160>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:38.787610 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7a60abe1-0024-4be2-b904-6552cea0ffa9 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 200 len: 288 microversion: 2.1 time: 0.155567 Aug 29 20:13:38.788253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 10/18] 10.222.0.121 () {58 vars in 1256 bytes} [Mon Aug 29 20:13:38 2022] GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 288 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:38.799657 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ccfdf235-79ec-40a0-a472-99371e8132d6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a28d310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:38.959526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ccfdf235-79ec-40a0-a472-99371e8132d6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "DELETE /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 202 len: 0 microversion: 2.1 time: 0.163957 Aug 29 20:13:38.963952 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 9/19] 10.222.0.121 () {58 vars in 1259 bytes} [Mon Aug 29 20:13:38 2022] DELETE /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:13:38.974234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-25d69399-0af5-49b4-a78c-ec422cba665c tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a225040>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:39.019480 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-25d69399-0af5-49b4-a78c-ec422cba665c tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 200 len: 287 microversion: 2.1 time: 0.049876 Aug 29 20:13:39.024793 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 11/20] 10.222.0.121 () {58 vars in 1256 bytes} [Mon Aug 29 20:13:38 2022] GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:40.033103 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3529a77-0f2e-408e-b12d-f332997bc631 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a27f310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:40.088032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-e3529a77-0f2e-408e-b12d-f332997bc631 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] HTTP exception thrown: Snapshot e2b18f76-1276-464f-b839-dcecb472b81a could not be found. Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3529a77-0f2e-408e-b12d-f332997bc631 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Request method failure captured: Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a HTTP/1.1 Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR3pBCp2iWz9j6q14ksHkv87atxcZN3JWTIPPazyYttsT6hsp0AKEgs7I1FHcYoGEd9vABacmco35J_ShDt9XqyfMlEF5llLqbldZXqmeskwWeSYgeG-iZ98S8Gn7lBRvSM-B9kt2gGgkb6ftLqQVXqHwwRRijihMTYnrkpa3uR2txU Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:13:40.090249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_f1d0d860148d4938bf9992bc1d7ac993", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}] Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: b278f115894a42ff95c2e6e1f035a6d9 Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Snapshot e2b18f76-1276-464f-b839-dcecb472b81a could not be found. Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'e2b18f76-1276-464f-b839-dcecb472b81a'} Aug 29 20:13:40.091426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e2b18f76-1276-464f-b839-dcecb472b81a could not be found. (HTTP 404) (Request-ID: req-2ad04da3-3540-4dd9-9a43-d4da9cb47c8c) Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:40.092109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:40.093081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e2b18f76-1276-464f-b839-dcecb472b81a could not be found. Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 20:13:40.093997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e2b18f76-1276-464f-b839-dcecb472b81a could not be found. Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e2b18f76-1276-464f-b839-dcecb472b81a could not be found. Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3529a77-0f2e-408e-b12d-f332997bc631 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Returning 404 to user: Snapshot e2b18f76-1276-464f-b839-dcecb472b81a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:40.095005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3529a77-0f2e-408e-b12d-f332997bc631 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a" status: 404 len: 111 microversion: 2.1 time: 0.064015 Aug 29 20:13:40.097556 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 10/21] 10.222.0.121 () {58 vars in 1256 bytes} [Mon Aug 29 20:13:40 2022] GET /compute/v2.1/os-snapshots/e2b18f76-1276-464f-b839-dcecb472b81a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:13:40.101455 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-192ec966-5e9b-4549-8062-37d3aeaab32d tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a225700>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:40.332829 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-192ec966-5e9b-4549-8062-37d3aeaab32d tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870" status: 202 len: 0 microversion: 2.1 time: 0.235384 Aug 29 20:13:40.333591 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 12/22] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:13:40 2022] DELETE /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:13:40.341677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6902ead-fac4-482b-acec-bae7f0655760 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a28d430>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:40.476578 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6902ead-fac4-482b-acec-bae7f0655760 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870" status: 200 len: 344 microversion: 2.1 time: 0.138553 Aug 29 20:13:40.477218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 11/23] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:13:40 2022] GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:41.494170 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-989cbea3-1dbc-4f7e-a6d1-2a3001fb2b75 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a289280>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:41.565178 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-989cbea3-1dbc-4f7e-a6d1-2a3001fb2b75 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] HTTP exception thrown: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-989cbea3-1dbc-4f7e-a6d1-2a3001fb2b75 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Request method failure captured: Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 HTTP/1.1 Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3pBCp2iWz9j6q14ksHkv87atxcZN3JWTIPPazyYttsT6hsp0AKEgs7I1FHcYoGEd9vABacmco35J_ShDt9XqyfMlEF5llLqbldZXqmeskwWeSYgeG-iZ98S8Gn7lBRvSM-B9kt2gGgkb6ftLqQVXqHwwRRijihMTYnrkpa3uR2txU Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:13:41.570915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_f1d0d860148d4938bf9992bc1d7ac993", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}] Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: b278f115894a42ff95c2e6e1f035a6d9 Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '0cccf676-d2c6-42ec-893e-55ddd7212870'} Aug 29 20:13:41.572270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. (HTTP 404) (Request-ID: req-e92ac372-7bea-42a0-99e0-36ada199145c) Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.573105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:41.574340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:13:41.575520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.576618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.578871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-989cbea3-1dbc-4f7e-a6d1-2a3001fb2b75 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Returning 404 to user: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:41.580989 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-989cbea3-1dbc-4f7e-a6d1-2a3001fb2b75 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870" status: 404 len: 109 microversion: 2.1 time: 0.092661 Aug 29 20:13:41.591184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 13/24] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:13:41 2022] GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:13:41.596559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-985dddbb-75ba-4468-a87d-68e3d0b8b3b6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a27f820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:41.653980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-985dddbb-75ba-4468-a87d-68e3d0b8b3b6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] HTTP exception thrown: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-985dddbb-75ba-4468-a87d-68e3d0b8b3b6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Request method failure captured: Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 HTTP/1.1 Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR3pBCp2iWz9j6q14ksHkv87atxcZN3JWTIPPazyYttsT6hsp0AKEgs7I1FHcYoGEd9vABacmco35J_ShDt9XqyfMlEF5llLqbldZXqmeskwWeSYgeG-iZ98S8Gn7lBRvSM-B9kt2gGgkb6ftLqQVXqHwwRRijihMTYnrkpa3uR2txU Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:13:41.656057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_f1d0d860148d4938bf9992bc1d7ac993", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}] Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: b278f115894a42ff95c2e6e1f035a6d9 Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '0cccf676-d2c6-42ec-893e-55ddd7212870'} Aug 29 20:13:41.657384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. (HTTP 404) (Request-ID: req-c60e397f-0634-4d98-8925-ceb152d9ef04) Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.658156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:13:41.661259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:13:41.662347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-985dddbb-75ba-4468-a87d-68e3d0b8b3b6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Returning 404 to user: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-985dddbb-75ba-4468-a87d-68e3d0b8b3b6 tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870" status: 404 len: 109 microversion: 2.1 time: 0.068077 Aug 29 20:13:41.663451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 12/25] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:13:41 2022] DELETE /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:13:41.669084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c3b35168-277b-4edd-bc68-92835b30fe9b tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Calling method '.version_select at 0x7f446a222040>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:41.716787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-c3b35168-277b-4edd-bc68-92835b30fe9b tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] HTTP exception thrown: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c3b35168-277b-4edd-bc68-92835b30fe9b tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Request method failure captured: Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 HTTP/1.1 Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3pBCp2iWz9j6q14ksHkv87atxcZN3JWTIPPazyYttsT6hsp0AKEgs7I1FHcYoGEd9vABacmco35J_ShDt9XqyfMlEF5llLqbldZXqmeskwWeSYgeG-iZ98S8Gn7lBRvSM-B9kt2gGgkb6ftLqQVXqHwwRRijihMTYnrkpa3uR2txU Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:13:41.719506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_f1d0d860148d4938bf9992bc1d7ac993", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/f1d0d860148d4938bf9992bc1d7ac993"}]}] Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: f1d0d860148d4938bf9992bc1d7ac993 Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2143779039 Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: b278f115894a42ff95c2e6e1f035a6d9 Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2143779039-project Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '0cccf676-d2c6-42ec-893e-55ddd7212870'} Aug 29 20:13:41.720509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. (HTTP 404) (Request-ID: req-6a4bbf63-4e10-4c6a-9a59-36c60c053fd3) Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.721105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:13:41.722506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:13:41.725635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. Aug 29 20:13:41.727826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:13:41.732298 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c3b35168-277b-4edd-bc68-92835b30fe9b tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] Returning 404 to user: Volume 0cccf676-d2c6-42ec-893e-55ddd7212870 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:13:41.732681 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c3b35168-277b-4edd-bc68-92835b30fe9b tempest-VolumesSnapshotsTestJSON-2143779039 tempest-VolumesSnapshotsTestJSON-2143779039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870" status: 404 len: 109 microversion: 2.1 time: 0.066668 Aug 29 20:13:41.733799 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 14/26] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:13:41 2022] GET /compute/v2.1/os-volumes/0cccf676-d2c6-42ec-893e-55ddd7212870 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:13:43.376375 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9cd2562d-97d8-4b39-ba6e-d076911a74b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'create', calling method: .version_select at 0x7f446a28d3a0>, body: {"keypair": {"name": "tempest-keypair-2104690771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+aAoYJ9s++KsiD0qnMEegHHcNZ0NhqRJ6VZxDPoLkXk7+yvrWG4Q1vEI7L/OS2ODyMx3E5sYv6koBKRe6ISM5TLpz8L0D9rEnBYNlse/1Iy2FC2AJva6MuhYFN9xO8kw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:43.516151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9cd2562d-97d8-4b39-ba6e-d076911a74b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for project 7f8f374198d34097b4deee456a3b3be7. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:13:43.548115 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9cd2562d-97d8-4b39-ba6e-d076911a74b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for user 7ce1e14c83aa47c184750585f941ecb0 and project 7f8f374198d34097b4deee456a3b3be7. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:13:43.675892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9cd2562d-97d8-4b39-ba6e-d076911a74b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.872088 Aug 29 20:13:43.680360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 13/27] 10.222.0.121 () {62 vars in 1205 bytes} [Mon Aug 29 20:13:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 877 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 20:13:49.439317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-931dd46a-66bc-419c-a3d8-b616df492eb9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: .version_select at 0x7f446a289ee0>, body: {"keypair": {"name": "tempest-keypair-780097926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJM0mW/3KGAhSjvsTRgO9zg7zjT7F6ayk1eMCvytSKd4tsUM6iDCiH025Mx4CHi9xIYOEW3AAAtA4ksfBEHwRvslKDSOBLiSEw0eN8ram76kWoKxJTXLoZaw0v2lIYPBA=="}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:49.597028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1834971243", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "networks": [{"uuid": "a7246e50-7cfc-4b92-907f-97f2f289e45a"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:49.638468 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-931dd46a-66bc-419c-a3d8-b616df492eb9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:13:49.676879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-931dd46a-66bc-419c-a3d8-b616df492eb9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:13:49.829765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-931dd46a-66bc-419c-a3d8-b616df492eb9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.435802 Aug 29 20:13:49.844072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 15/28] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:13:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:13:49.858265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] validate_networks() for [('a7246e50-7cfc-4b92-907f-97f2f289e45a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:13:49.873874 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-531880595", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cda60e18-c78a-4bea-8422-1302e74d6cc6"}], "security_groups": [{"name": "tempest-securitygroup--1925776974"}], "key_name": "tempest-keypair-2104690771", "user_data": "}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:50.962649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] validate_networks() for [('cda60e18-c78a-4bea-8422-1302e74d6cc6', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:13:53.195991 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:13:53.196509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:13:53.196874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:13:53.197360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:13:53.197874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:13:53.202403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:13:53.202916 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:13:53.203411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:13:53.204046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:13:53.205252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:13:53.224249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.224521 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.224971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.225676 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.226131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.226607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.228995 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.231710 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.234250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.235193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:53.236765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:53.237377 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:53.288205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Getting quotas for project 55868f6aefc34b9786ca7489fd84e9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:13:53.297848 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Getting quotas for user 7303746fd134433f9ca3035a40684277 and project 55868f6aefc34b9786ca7489fd84e9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:13:53.321194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:13:53.326472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:13:53.351445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for project 7f8f374198d34097b4deee456a3b3be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:13:53.356395 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for user 7ce1e14c83aa47c184750585f941ecb0 and project 7f8f374198d34097b4deee456a3b3be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:13:53.389086 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:13:53.397023 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:13:53.446444 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a05166c2-9b6d-4ee0-a6d5-48959e4841c3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.793432 Aug 29 20:13:53.448260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 14/29] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:13:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 4800 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:13:53.575631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8b7e10ee-1b6d-46bf-b9d5-3ea9b848ec62 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 3.707826 Aug 29 20:13:53.577986 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 16/30] 10.222.0.121 () {62 vars in 1193 bytes} [Mon Aug 29 20:13:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 3713 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 20:13:53.601745 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-14a9bb7e-6201-444a-a2a2-1fc3c3d0ae95 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:53.605246 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-14a9bb7e-6201-444a-a2a2-1fc3c3d0ae95 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:53.894152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-14a9bb7e-6201-444a-a2a2-1fc3c3d0ae95 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:53.925961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-409493171", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:53.938814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-14a9bb7e-6201-444a-a2a2-1fc3c3d0ae95 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1219 microversion: 2.1 time: 0.356153 Aug 29 20:13:53.940102 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 17/31] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:13:53 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1219 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:53.958212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b86d577a-7524-40b1-8762-16de7da6ab7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:53.977130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b86d577a-7524-40b1-8762-16de7da6ab7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:54.110704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] validate_networks() for [('5d90d67e-b915-4e8e-aedc-6d41260ae197', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:13:54.213220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b86d577a-7524-40b1-8762-16de7da6ab7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:54.223593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b86d577a-7524-40b1-8762-16de7da6ab7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:54.227552 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b86d577a-7524-40b1-8762-16de7da6ab7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:54.229946 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b86d577a-7524-40b1-8762-16de7da6ab7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1285 microversion: 2.20 time: 0.285827 Aug 29 20:13:54.232380 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 18/32] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:13:53 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1285 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:13:54.784460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607638307", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "190f63a4-9b8c-4268-a1f5-7e230ea6f86c"}], "security_groups": [{"name": "tempest-securitygroup--1320542579"}], "key_name": "tempest-keypair-780097926", "user_data": "}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:55.178822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] validate_networks() for [('190f63a4-9b8c-4268-a1f5-7e230ea6f86c', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:13:55.339555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:13:55.341168 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:13:55.341879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:13:55.343057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:13:55.343670 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:13:55.368123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:55.374102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:55.374921 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:55.382603 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:55.384943 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:55.385712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:55.456269 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for project eaabbc4be9754bcda6adc796a0340c49. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:13:55.483136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for user 58bf9cf55cfc45d3841366f601abe4f8 and project eaabbc4be9754bcda6adc796a0340c49. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:13:55.528223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:13:55.537599 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:13:55.686372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da41a079-d6ab-4961-9965-3b237379c213 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.235887 Aug 29 20:13:55.690763 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 15/33] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:13:53 2022] POST /compute/v2.1/servers => generated 385 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:13:55.705635 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15b9ae0e-cf26-4ec2-8a6a-02e9b6095a3b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:55.716544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15b9ae0e-cf26-4ec2-8a6a-02e9b6095a3b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:56.123290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-15b9ae0e-cf26-4ec2-8a6a-02e9b6095a3b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:56.185650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15b9ae0e-cf26-4ec2-8a6a-02e9b6095a3b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1219 microversion: 2.1 time: 0.467779 Aug 29 20:13:56.203070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 16/34] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:13:55 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1219 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:56.216623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c209cc05-55a6-4f90-bb20-0bfb0f17cf4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:56.217250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c209cc05-55a6-4f90-bb20-0bfb0f17cf4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:57.000126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c209cc05-55a6-4f90-bb20-0bfb0f17cf4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.009059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c209cc05-55a6-4f90-bb20-0bfb0f17cf4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.014037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c209cc05-55a6-4f90-bb20-0bfb0f17cf4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.015418 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c209cc05-55a6-4f90-bb20-0bfb0f17cf4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1285 microversion: 2.20 time: 0.811236 Aug 29 20:13:57.018806 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 17/35] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:13:56 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1285 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:13:57.027993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:57.028830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:57.052296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.055033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.055751 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.056691 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.059609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.060259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.120031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:13:57.121437 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:13:57.122140 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:13:57.125073 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:13:57.126914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:13:57.151627 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.152615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.153061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.159978 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.162341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.163676 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.266819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:13:57.285448 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:13:57.326540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:13:57.338762 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:13:57.449535 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.510048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1bde406-a4bd-4a76-80ac-c9d41f57211e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1229 microversion: 2.1 time: 0.489799 Aug 29 20:13:57.517049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 18/36] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:13:57 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1229 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:57.540017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:57.555816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:57.588667 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.592740 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6629bcfb-ceb4-44f6-9ec2-de975c628dc9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.815207 Aug 29 20:13:57.594580 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.597612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.603715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 19/37] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:13:54 2022] POST /compute/v2.1/servers => generated 404 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 29 20:13:57.604868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:57.605523 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:57.606598 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:57.641004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b4068380-c63a-49b7-b68f-09c2c2755dc6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:57.642205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b4068380-c63a-49b7-b68f-09c2c2755dc6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:57.846850 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b4068380-c63a-49b7-b68f-09c2c2755dc6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.869401 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b4068380-c63a-49b7-b68f-09c2c2755dc6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1245 microversion: 2.1 time: 0.255617 Aug 29 20:13:57.872701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 20/38] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:13:57 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1245 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:57.926453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1758512289", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:13:57.977541 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:57.996927 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eaf5df1d-b364-40de-8b9e-e02d49939029 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1271 microversion: 2.1 time: 0.469013 Aug 29 20:13:57.997560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 19/39] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:13:57 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1271 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:58.067795 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:58.074090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:58.113134 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.113638 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.119291 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:58.121990 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.136042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.138013 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:58.139534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] validate_networks() for [('5d90d67e-b915-4e8e-aedc-6d41260ae197', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:13:58.560730 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:58.587036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:58.588737 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:58.607437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8895f0c7-903f-4fa4-8bc2-e8888cbcb1e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1337 microversion: 2.20 time: 0.545158 Aug 29 20:13:58.617360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 20/40] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:13:58 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1337 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:13:58.894478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:58.895496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:58.914962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.921173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.922074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:58.927799 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:58.932510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:58.933295 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.198427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:59.211768 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e608aa5b-2be7-4ea8-b86e-006bfdd98a37 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1249 microversion: 2.1 time: 0.319651 Aug 29 20:13:59.213090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 21/41] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:13:58 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1249 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:59.225349 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:59.227232 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:59.240834 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:59.245371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:59.246085 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.247209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:59.250067 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:59.250733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.525062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:59.539266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a47b7187-6d0f-4192-ab59-615a424056d6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1277 microversion: 2.1 time: 0.323801 Aug 29 20:13:59.557678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 22/42] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:13:59 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:13:59.634964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:13:59.635807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:13:59.650506 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:59.651379 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:59.652103 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.653032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:13:59.653718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:13:59.654486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:13:59.818900 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:59.835478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:59.838905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:13:59.842701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfcff1cc-2753-4992-87db-de4b37e29a9d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1343 microversion: 2.20 time: 0.214324 Aug 29 20:13:59.868436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 23/43] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:13:59 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1343 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:00.086487 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:14:00.087573 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:14:00.088206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:14:00.088767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:14:00.089341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:14:00.104524 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.106800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.107837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.112049 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.113841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.115722 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.189567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for project eaabbc4be9754bcda6adc796a0340c49. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:14:00.209596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for user 58bf9cf55cfc45d3841366f601abe4f8 and project eaabbc4be9754bcda6adc796a0340c49. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:14:00.236801 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:00.237723 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:00.274871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.275108 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:14:00.280812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.288443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.296203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.297438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.301110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.304801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:14:00.471125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c9db8463-9f4a-4f3c-ad36-7a1860bfc7f1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.554613 Aug 29 20:14:00.479205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 21/44] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:13:57 2022] POST /compute/v2.1/servers => generated 385 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:14:00.508846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-61ed5db2-dc0a-42a0-8b02-3c25e5ce5999 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:00.525613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-61ed5db2-dc0a-42a0-8b02-3c25e5ce5999 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:00.814813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:00.824698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0964ed4d-64f7-48f6-ac70-6a56e441c429 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1297 microversion: 2.1 time: 0.593618 Aug 29 20:14:00.831752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 24/45] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:00 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1297 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:00.851330 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:00.852481 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:00.873817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.877981 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.879584 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.881788 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:00.882653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:00.884923 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:00.948716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-61ed5db2-dc0a-42a0-8b02-3c25e5ce5999 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:00.957477 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-61ed5db2-dc0a-42a0-8b02-3c25e5ce5999 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1226 microversion: 2.1 time: 0.476982 Aug 29 20:14:00.970770 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 22/46] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:00 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1226 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:00.991543 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:00.992883 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:01.005118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:01.006442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:01.007118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:01.008615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:01.009334 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:01.010057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:01.277272 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:01.294607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c8f5d7f-a11c-4d9c-a9ce-a571d6d9c53f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1277 microversion: 2.1 time: 0.460956 Aug 29 20:14:01.308664 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 25/47] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:00 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1277 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:01.592109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:01.632205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:01.640426 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:01.642987 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-54e38058-483b-4b95-8375-237702f3d7ad tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1343 microversion: 2.20 time: 0.670851 Aug 29 20:14:01.648778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 23/48] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:00 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1343 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:01.851767 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:01.853217 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:01.878273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:01.884311 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:01.889356 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:01.890794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:01.894276 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:01.895324 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:01.981405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:01.982944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:02.008105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.010441 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.013315 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.018566 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.020242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.021836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.158811 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:02.182426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-666eb46b-d621-4344-a015-c0b6455ccbfe tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1303 microversion: 2.1 time: 0.336705 Aug 29 20:14:02.191610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 26/49] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:01 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1303 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:02.296588 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:02.313640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-da7b2285-2dee-44fc-a0d4-c44c891a6985 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1230 microversion: 2.1 time: 0.335485 Aug 29 20:14:02.320238 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 24/50] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:01 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1230 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:02.338761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:02.340338 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:02.363104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.370720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.371234 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.377296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.379590 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.382513 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.675026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:02.676642 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:02.699439 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.703927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.706435 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.709996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:02.713640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:02.716030 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:02.866394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:02.875889 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc16834b-df82-4306-a53c-44a0de5164c8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1277 microversion: 2.1 time: 0.557306 Aug 29 20:14:02.887141 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 27/51] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:02 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1277 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:03.024520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:03.058347 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:03.076759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:03.082592 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-42abe2fa-0f1e-4c1a-b130-e983d5739a46 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1343 microversion: 2.20 time: 0.410517 Aug 29 20:14:03.099658 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 25/52] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:02 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1343 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:03.205411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:03.206385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:03.215794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.219881 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.222794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:03.226373 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.232684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.236677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:03.344700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:03.346107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:03.361739 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.365513 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.367587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:03.369801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.379857 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.380456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:03.477059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:03.489858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62885c3d-6188-4285-a4ea-d094bd6dac39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1303 microversion: 2.1 time: 0.289030 Aug 29 20:14:03.495446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 28/53] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:03 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:03.917694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:03.917694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:03.971353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:03.971863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:03.982604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:04.000614 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:04.001168 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:04.021722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:04.060167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:04.096189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d6f65071-3b1e-45b4-a5e0-f1232930d605 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1278 microversion: 2.1 time: 0.754918 Aug 29 20:14:04.097537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 26/54] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:03 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1278 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:04.125697 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:04.129437 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:04.148668 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:04.152611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:04.153199 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:04.157791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:04.163402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:04.166296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:05.421331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:05.438661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:05.448036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a767e776-0a24-4f17-90f4-ee3671ee32cb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 1.543802 Aug 29 20:14:05.455223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 29/55] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:03 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:05.460205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:05.475475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:05.503351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:05.504393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:05.505155 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:05.506064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:05.506671 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:05.507281 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.089956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:06.102636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:06.107941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:06.111321 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-869f4088-9369-4271-bead-01f5d9f7ca9b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 1.993287 Aug 29 20:14:06.116980 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 27/56] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:04 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:06.126007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:06.129149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:06.140538 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.143000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.143956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.146762 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.148180 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.150294 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.260675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:06.270534 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f73a8a11-dc7e-4676-a989-0ff31d0d256c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.813960 Aug 29 20:14:06.288913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 30/57] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:05 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:06.479785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:06.480445 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:06.496699 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.497204 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.497640 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:06.498471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:06.507173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:06.507726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.010751 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=20 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:07.575326 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:07.601451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-483c6310-1fa9-49c9-bac6-b6cc18720aca tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 1.126878 Aug 29 20:14:07.604950 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 31/58] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:06 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:07.648007 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:07.649950 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:07.662996 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.663877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.665560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.666503 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.675696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:07.684163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-deba9517-b2de-4508-b037-6037730f3965 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 1.565864 Aug 29 20:14:07.685013 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.686137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.704885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 28/59] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:06 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:07.709837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:07.728159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:07.739055 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.739704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.743599 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:07.744426 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:07.745015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:07.745542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.634020 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:08.637787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:08.646131 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ee0fa5ee-1354-450a-916a-1fdb6afb7c9a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.939946 Aug 29 20:14:08.659102 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 29/60] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:07 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:08.659487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:08.659487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:08.659487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8061a8fe-7ca5-45b3-bc56-dd82182e5f06 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 1.023203 Aug 29 20:14:08.659708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:08.660106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:08.676283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 32/61] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:07 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:08.681401 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.681953 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.682342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.683032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.683515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.694353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.734778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:08.735961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:08.763496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.784451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.785702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:08.787863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:08.788363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:08.790447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.209107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:09.222605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-924b1f8a-1774-4df9-8b04-c209951a68f0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.574179 Aug 29 20:14:09.227439 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:09.231569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:09.236613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 30/62] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:08 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:09.239539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-451aa7c6-1c30-4b9a-b37f-df8940ea4a2d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.513124 Aug 29 20:14:09.251114 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 33/63] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:08 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:09.685912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:09.685912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:09.691563 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:09.692180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:09.698266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.698778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.701619 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.703518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.704266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.704481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.704852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.705403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.706010 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:09.733764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:09.735012 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:09.735784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:10.053760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.067621 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-96ab1b6e-3b41-40fa-8a1e-63d1e6b639c6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.400070 Aug 29 20:14:10.080191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 31/64] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:09 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:10.182851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.196362 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.199567 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.203020 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eebeed72-5dff-4c5f-a16a-0b2742f1530c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.524239 Aug 29 20:14:10.206164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 34/65] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:09 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:10.246156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:10.246770 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:10.255585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:10.256612 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:10.263292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:10.264312 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:10.273065 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:10.275070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:10.280320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:10.281336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:10.281954 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:10.282638 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:10.286257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:10.289483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:10.291929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:10.295285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:10.295285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:10.296021 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:10.297203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:10.939716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.941700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:10.953715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ecafb8db-eddc-468c-82da-23bdcf51feb7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.711493 Aug 29 20:14:10.955134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 32/66] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:10 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:10.967038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=30 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:10.967474 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ea7cf9e-e6aa-4830-aa51-2dd842afb17c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.704762 Aug 29 20:14:10.982290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 35/67] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:10 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:11.082136 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-d105ec4c-a97e-4ce7-ae1a-2c9e7cb9446e req-b9626bcf-e227-4539-a829-acbf3a9f7e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a078027c-0fda-486c-9f40-ac527c610a4c", "tag": "42fa43bf-f892-46be-b812-4b6d81b4ea2d"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:11.102597 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9dd51544-d1f3-445c-b5aa-6cea1fe13a6f req-04886f57-4260-4d62-8a7e-e9831417d229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489e0150-911d-4e6b-9bd1-15903a23dc3c", "tag": "882553ff-4ac3-48cc-9d4b-77e541c96a98"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:11.103842 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d105ec4c-a97e-4ce7-ae1a-2c9e7cb9446e req-b9626bcf-e227-4539-a829-acbf3a9f7e77 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.104530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d105ec4c-a97e-4ce7-ae1a-2c9e7cb9446e req-b9626bcf-e227-4539-a829-acbf3a9f7e77 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.105099 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d105ec4c-a97e-4ce7-ae1a-2c9e7cb9446e req-b9626bcf-e227-4539-a829-acbf3a9f7e77 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.117382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9dd51544-d1f3-445c-b5aa-6cea1fe13a6f req-04886f57-4260-4d62-8a7e-e9831417d229 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.118124 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9dd51544-d1f3-445c-b5aa-6cea1fe13a6f req-04886f57-4260-4d62-8a7e-e9831417d229 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.118703 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9dd51544-d1f3-445c-b5aa-6cea1fe13a6f req-04886f57-4260-4d62-8a7e-e9831417d229 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.139367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9dd51544-d1f3-445c-b5aa-6cea1fe13a6f req-04886f57-4260-4d62-8a7e-e9831417d229 service nova] Creating event network-changed:882553ff-4ac3-48cc-9d4b-77e541c96a98 for instance 489e0150-911d-4e6b-9bd1-15903a23dc3c on hv-cinder-85426 Aug 29 20:14:11.140188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9dd51544-d1f3-445c-b5aa-6cea1fe13a6f req-04886f57-4260-4d62-8a7e-e9831417d229 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:14:11.140739 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9dd51544-d1f3-445c-b5aa-6cea1fe13a6f req-04886f57-4260-4d62-8a7e-e9831417d229 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:14:11.142125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.142732 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.143344 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.144232 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.144681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.145099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.150163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-d105ec4c-a97e-4ce7-ae1a-2c9e7cb9446e req-b9626bcf-e227-4539-a829-acbf3a9f7e77 service nova] Creating event network-changed:42fa43bf-f892-46be-b812-4b6d81b4ea2d for instance a078027c-0fda-486c-9f40-ac527c610a4c on hv-cinder-85426 Aug 29 20:14:11.153975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.compute.rpcapi [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:14:11.154773 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d105ec4c-a97e-4ce7-ae1a-2c9e7cb9446e req-b9626bcf-e227-4539-a829-acbf3a9f7e77 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:14:11.154885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] Releasing lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:14:11.156971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d105ec4c-a97e-4ce7-ae1a-2c9e7cb9446e req-b9626bcf-e227-4539-a829-acbf3a9f7e77 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:14:11.158094 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.158559 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.158985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.159729 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.163630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.164172 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.170970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e4cf2d9-4a38-434d-abb2-72cdb8c8bfb4 None None] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193389 Aug 29 20:14:11.172196 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 36/68] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:11.174304 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.compute.rpcapi [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:14:11.175781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] Releasing lock "compute-rpcapi-router" {{(pid=120721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:14:11.179775 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:11.180973 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:11.190322 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.190849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.191310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.192056 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.192510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.192930 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.203301 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d8dc3ad2-6b98-41cc-995c-be7adc936add None None] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246450 Aug 29 20:14:11.204086 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 33/69] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:11.230686 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:11.231413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:11.239035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.239934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.240368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.241110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.241566 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.241982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.414980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:11.426747 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da5e71d5-3143-418b-aa02-428950616c5b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.252460 Aug 29 20:14:11.431490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 37/70] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:11 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:11.446329 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:11.454581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:11.456284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:11.457388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-989e31d5-f11f-4c9d-a384-ce59d07f125d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.231344 Aug 29 20:14:11.457941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 34/71] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:11 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:11.977803 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:11.979027 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:11.996000 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.996841 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.997370 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:11.998182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:11.998427 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:11.998897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:11.999039 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:11.999477 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.018442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.019222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.019831 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.021345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.021948 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.022515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.211260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:12.215938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:12.220305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c7de498-4606-4061-ac93-751c898447bf tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.246186 Aug 29 20:14:12.227631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 38/72] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:11 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:12.227813 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c3edba7e-eca6-4274-aa3c-7a0b41803071 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.241193 Aug 29 20:14:12.228564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 35/73] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:11 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:12.448153 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:12.448855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:12.455905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.456694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.457309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.458166 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.458767 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.459363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.480539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:12.481139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:12.487828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.488309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.488743 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.489439 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:12.489891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:12.490317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:12.659053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:12.676000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:12.676157 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31709b21-7157-499a-a9fa-2515ea7b7c23 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.231663 Aug 29 20:14:12.676619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 39/74] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:12 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:12.685211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:12.686716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:12.688144 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7ec76b07-6204-4552-8776-5fc2aae7ea5e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.211397 Aug 29 20:14:12.688975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 36/75] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:12 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:13.218580 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ad0c45-261e-4857-a9bb-30cdd91fc949", "tag": "f3776018-6607-4aae-859e-5e055ca8c72d"}, {"name": "network-changed", "server_uuid": "87ca18a5-9e7c-494f-ab36-244c102fcd9c", "tag": "392323eb-c6ee-4e5d-b1fc-f753dc8fa07f"}, {"name": "network-changed", "server_uuid": "2ee34ea9-ae27-4156-8f42-17d06286bebe", "tag": "a973a1f7-934c-4d30-ac16-cec9f03a8bfe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:13.230372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.230846 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.231304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.242095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:13.243767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:13.248539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] Creating event network-changed:f3776018-6607-4aae-859e-5e055ca8c72d for instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 on hv-cinder-85426 Aug 29 20:14:13.249761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] Creating event network-changed:392323eb-c6ee-4e5d-b1fc-f753dc8fa07f for instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c on hv-cinder-85426 Aug 29 20:14:13.250471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] Creating event network-changed:a973a1f7-934c-4d30-ac16-cec9f03a8bfe for instance 2ee34ea9-ae27-4156-8f42-17d06286bebe on hv-cinder-85426 Aug 29 20:14:13.251233 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.251938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.252647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.253577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.254352 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.254973 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.259057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3f9b2634-fa52-4ae9-add1-8fa4372611b2 req-037f1668-f201-44bb-84f3-7cdd3361448d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.044087 Aug 29 20:14:13.259866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 40/76] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:13.264493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:13.265783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:13.272424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.272901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.273328 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.274013 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.274460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.274874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.467193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:13.475022 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:13.475966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-faccb199-8286-4313-84b6-4c81f3758c03 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.237839 Aug 29 20:14:13.484247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e591558-1c91-460b-9bc5-062e9621c2d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.222904 Aug 29 20:14:13.487539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 41/77] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:13 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:13.495822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 37/78] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:13 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:13.696596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:13.697433 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:13.704083 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.705887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.705887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.705887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.706256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.706688 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.711516 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:13.712110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:13.719133 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.719873 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.720299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.721028 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:13.721479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:13.721893 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:13.913034 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:13.928848 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba6eedb7-0821-4619-8d95-533e093ce90c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.235477 Aug 29 20:14:13.930159 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 42/79] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:13 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:13.941577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:13.945283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=100 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:13.950540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:13.951955 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:13.953093 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e0ffe447-3d4d-46c5-b4f9-d3bd92792442 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.245495 Aug 29 20:14:13.953708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 38/80] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:13 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:14.502442 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:14.502993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:14.509329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.509812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.510250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.510948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.511451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.511858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.521841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:14.522557 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:14.529144 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.529623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.530046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.530894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.531623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.532196 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.724178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:14.730413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:14.735700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e371f03-7411-418a-b701-66e8378eeb9c tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.237514 Aug 29 20:14:14.736284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 43/81] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:14 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:14.738567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-062958b2-fcc0-46d3-a0eb-2060a0c6b3b0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.221134 Aug 29 20:14:14.739187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 39/82] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:14 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:14.949189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:14.949790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:14.955803 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.956277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.956700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.957376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.957820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.958233 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.978494 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:14.979144 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:14.987487 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.988085 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.989308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:14.990054 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:14.990655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:14.991118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:15.264061 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:15.274919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97e8be90-e4d9-4445-b30c-02b09569c9d0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.329582 Aug 29 20:14:15.275813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 44/83] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:14 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:15.369085 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:15.386826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:15.388389 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:15.389598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a33a5426-4005-4f7d-9324-32b3256e52c2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.417380 Aug 29 20:14:15.402110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 40/84] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:14 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:15.770255 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:15.772083 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:15.773112 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:15.777194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:15.801104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:15.801708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:15.802834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:15.803318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:15.805113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:15.805775 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:15.806796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:15.808025 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:15.809363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:15.811427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:15.811427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:15.813516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:16.401807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:16.404556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:16.412402 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98b771ea-482d-47b2-b156-bcc2716d1014 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.656543 Aug 29 20:14:16.413080 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 45/85] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:15 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:16.415035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ffed8071-401f-4da9-afb4-0d858213897d tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.655418 Aug 29 20:14:16.415812 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 41/86] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:15 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:16.420569 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:16.422112 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:16.429671 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:16.430241 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:16.430355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:16.430778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:16.430887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:16.431680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:16.432205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:16.432738 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:16.438835 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:16.439550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:16.440073 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:16.440881 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:16.441409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:16.441904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:16.652162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:16.663531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:16.672575 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:16.674027 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:16.677679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1ede3c97-24de-4654-95fc-833c6dfc7142 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.258213 Aug 29 20:14:16.680549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92fc3662-cc9a-42d3-bc15-4be57800bffa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.266141 Aug 29 20:14:16.680969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 42/87] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:16 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:16.695304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 46/88] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:16 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:17.435975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:17.437160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:17.437818 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:17.438208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:17.446146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.448687 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.449206 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.451601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.452802 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.453011 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.453995 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.454116 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.454640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.455314 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.455963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.460114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.881694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:17.890867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f1aa953-08c6-483e-b72c-072d2d7d49e3 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.457808 Aug 29 20:14:17.907466 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 47/89] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:17 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:17.915725 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:17.917147 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:17.920443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:17.925236 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.926014 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.926742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.928099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.928701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.929468 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.931912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2232d8bb-4b75-43b0-b04d-1dae99c391ce tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.501281 Aug 29 20:14:17.932587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 43/90] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:17 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:17.950754 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:17.955927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:17.973006 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.973507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.974128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:17.974990 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:17.975626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:17.976182 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:18.445356 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:18.453500 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46c70b8f-a673-460f-b207-2dc368422e32 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.544020 Aug 29 20:14:18.461987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 48/91] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:17 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:18.474161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:18.487500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:18.489629 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:18.491171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-dd8a0147-cca1-4bf3-8c97-0eda37dfa249 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.554873 Aug 29 20:14:18.491813 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 44/92] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:17 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:18.913878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:18.914475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:18.920887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:18.921503 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:18.922279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:18.923118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:18.923766 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:18.924370 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:18.958944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:18.959686 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:18.965838 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:18.966698 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:18.967418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:18.968256 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:18.968855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:18.969474 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.109381 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:19.118102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb6c7a65-6589-4aeb-84ee-8297d5d18a24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.208546 Aug 29 20:14:19.119329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 49/93] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:18 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:19.158182 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:19.179450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-86fb3162-b3a0-4c23-8a18-b2eb6ba7c227 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.224224 Aug 29 20:14:19.192582 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 45/94] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:18 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:19.475402 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:19.476998 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:19.485876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.486646 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.487365 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.488333 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.489273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.489905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.519635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:19.520949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:19.529611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.530609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.531339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.532816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:19.533409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:19.534021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:19.955007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:19.964988 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:19.966615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:19.968496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0477c4ac-3963-4ff3-84f0-4360493b38e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.456606 Aug 29 20:14:19.980179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:19.981198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 46/95] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:19 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:20.000948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0c922bf-57f7-4681-9474-e1f9b653341f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.530605 Aug 29 20:14:20.001715 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 50/96] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:19 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:20.140596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:20.141221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:20.147253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:20.147740 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:20.148180 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:20.151632 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:20.152304 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:20.152905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:20.205468 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:20.206087 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:20.215610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:20.216113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:20.216549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:20.217849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:20.227898 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:20.234075 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:20.301807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:20.475846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:20.487805 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-45be6bdf-0f9c-4162-8f10-7c9c1e2fdc1e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.349906 Aug 29 20:14:20.491126 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 47/97] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:20 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:20.533024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:20.541238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-434bac4f-b205-4c45-b010-0ef9c2c2a61a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.340342 Aug 29 20:14:20.542471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 51/98] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:20 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:21.003581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:21.004739 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:21.011166 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.011888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.012515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.013203 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.013837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.014470 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.021876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:21.022582 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:21.031570 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.032980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.034058 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.037698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.039501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.040189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.151989 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:21.171119 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:21.251042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:21.259635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:21.261073 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:21.262175 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-16677c2c-5399-492d-96a3-8e82546c3b00 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.262824 Aug 29 20:14:21.265319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 48/99] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:20 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:21.266596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:21.278330 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3fad4786-5baf-485f-ab86-c822545da203 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.260195 Aug 29 20:14:21.279436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 52/100] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:21 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:21.509969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:21.510680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:21.523386 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.527189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.527189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.527189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.527189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.527518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.563695 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:21.564552 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:21.573621 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.574721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.577713 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:21.579560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:21.582139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:21.583140 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:22.003917 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:22.011818 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1956702b-65f0-4759-9e00-558339b3bd3f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.506489 Aug 29 20:14:22.015429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 49/101] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:21 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:22.049331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:22.066069 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c08c89e-6950-4d63-9515-56bbacd85a54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.507394 Aug 29 20:14:22.081258 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 53/102] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:21 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:22.202951 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-64d57509-ace8-4bdd-a2a4-508a507b9f6f req-56448da7-530a-4df8-8a33-0bb9a9e240d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ad0c45-261e-4857-a9bb-30cdd91fc949", "name": "network-vif-plugged", "status": "completed", "tag": "f3776018-6607-4aae-859e-5e055ca8c72d"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:22.214185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-64d57509-ace8-4bdd-a2a4-508a507b9f6f req-56448da7-530a-4df8-8a33-0bb9a9e240d7 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:22.214670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-64d57509-ace8-4bdd-a2a4-508a507b9f6f req-56448da7-530a-4df8-8a33-0bb9a9e240d7 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:22.215155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-64d57509-ace8-4bdd-a2a4-508a507b9f6f req-56448da7-530a-4df8-8a33-0bb9a9e240d7 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:22.228516 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-64d57509-ace8-4bdd-a2a4-508a507b9f6f req-56448da7-530a-4df8-8a33-0bb9a9e240d7 service nova] Creating event network-vif-plugged:f3776018-6607-4aae-859e-5e055ca8c72d for instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 on hv-cinder-85426 Aug 29 20:14:22.234883 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-64d57509-ace8-4bdd-a2a4-508a507b9f6f req-56448da7-530a-4df8-8a33-0bb9a9e240d7 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175018 Aug 29 20:14:22.235537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 50/103] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:14:22.286126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:22.287248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:22.294336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:22.294877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:22.303299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:22.304390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:22.307818 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:22.308852 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:22.309932 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:22.310441 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:22.318146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:22.318632 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:22.319301 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:22.319918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:22.320443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:22.325028 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:22.548052 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:22.557357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1cede810-eb91-430a-bcfd-331967f8c61e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.258931 Aug 29 20:14:22.558527 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 51/104] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:22 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:22.569247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:22.579664 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:22.581624 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:22.582830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85075d25-6cdf-44bb-bb82-ef3def4f7e2e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.300983 Aug 29 20:14:22.583624 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 54/105] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:22 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:23.033527 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:23.034783 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:23.040819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.041301 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.041760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.042457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.042910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.043369 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.089017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:23.089862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:23.096378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.096866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.097382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.098217 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.098793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.099238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.229310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:23.237907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-af1b96df-66c9-47c2-8d00-9297a15a9a1f tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.208241 Aug 29 20:14:23.238468 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 52/106] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:23 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:23.258066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:23.266371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa9b6273-d6e9-4fbe-8c1a-1373b9906dc2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.181222 Aug 29 20:14:23.266939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 55/107] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:23 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:23.577506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:23.578101 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:23.584070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.584543 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.584969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.585646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.586111 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.586509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.606245 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:23.606856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:23.613985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.615355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.615975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.616894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:23.617742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:23.618381 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:23.786374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:23.799427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:23.799956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-310f49ff-95f2-49b8-a80a-a042d4f42420 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.226171 Aug 29 20:14:23.800542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 53/108] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:23 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:23.825030 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:23.827041 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:23.834519 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-771af554-7404-449b-95fc-6d6989e5b542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.231437 Aug 29 20:14:23.835711 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 56/109] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:23 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:24.261014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:24.262557 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:24.267267 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-412e0166-0d9d-4f6b-a9b8-898d6ca33d96 req-30d99802-f4dc-4add-a3cc-c54e89cad6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a078027c-0fda-486c-9f40-ac527c610a4c", "name": "network-vif-plugged", "status": "completed", "tag": "42fa43bf-f892-46be-b812-4b6d81b4ea2d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:24.269661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.270422 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.271071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.272254 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.273479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.274483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.278928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-412e0166-0d9d-4f6b-a9b8-898d6ca33d96 req-30d99802-f4dc-4add-a3cc-c54e89cad6b4 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.279468 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-412e0166-0d9d-4f6b-a9b8-898d6ca33d96 req-30d99802-f4dc-4add-a3cc-c54e89cad6b4 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.279889 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-412e0166-0d9d-4f6b-a9b8-898d6ca33d96 req-30d99802-f4dc-4add-a3cc-c54e89cad6b4 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.291528 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-412e0166-0d9d-4f6b-a9b8-898d6ca33d96 req-30d99802-f4dc-4add-a3cc-c54e89cad6b4 service nova] Creating event network-vif-plugged:42fa43bf-f892-46be-b812-4b6d81b4ea2d for instance a078027c-0fda-486c-9f40-ac527c610a4c on hv-cinder-85426 Aug 29 20:14:24.298841 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-412e0166-0d9d-4f6b-a9b8-898d6ca33d96 req-30d99802-f4dc-4add-a3cc-c54e89cad6b4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035580 Aug 29 20:14:24.299804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 57/110] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:14:24.306681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:24.308061 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:24.316813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.317715 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.318321 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.319446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.320060 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.320960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.469302 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:24.477284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-85d5f8e5-1327-461c-944b-ce1c0bb04ba0 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.221718 Aug 29 20:14:24.491630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 54/111] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:24 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:24.520054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:24.528628 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0166c1b-d07f-4023-a0df-f623d087b082 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.227362 Aug 29 20:14:24.529869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 58/112] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:24 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:24.820500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:24.821130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:24.828134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.828882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.829254 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.830147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.830828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.831498 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.858251 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:24.859221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:24.871962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.872473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.876158 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:24.878147 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:24.891791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:24.892471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:25.320291 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:25.338683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-aafa8366-c1f2-4fa3-88e8-d09aeba82425 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.521958 Aug 29 20:14:25.352256 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 55/113] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:24 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:25.461890 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:25.475610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:25.478334 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:25.479859 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-527f039b-8799-4dd1-9a23-dd63ffc7b8d5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.626033 Aug 29 20:14:25.481793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 59/114] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:24 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:25.502931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:25.504251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:25.510614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:25.511663 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:25.512432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:25.513747 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:25.514447 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:25.515458 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:25.539875 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=100 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:25.554089 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:25.554692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:25.561608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:25.562287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:25.562910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:25.563808 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:25.564434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:25.565053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:25.732933 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:25.741055 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c1176ee1-eb72-43c1-86ee-05dabac4484b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.244335 Aug 29 20:14:25.751178 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 56/115] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:25 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:25.763261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:25.772327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfaf1bc9-8618-47c3-b3f0-fae342c31342 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.224220 Aug 29 20:14:25.772901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 60/116] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:25 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:26.363911 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:26.364517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:26.370470 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.371046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.371694 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.372674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.373484 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.374004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.507933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:26.508507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:26.519275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.520256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.520890 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.522550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.523226 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.524087 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.544952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:26.553495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a43ec560-879f-4299-b1a4-f7968e03e72c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.193442 Aug 29 20:14:26.554066 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 57/117] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:26 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:26.675822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:26.683886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:26.685991 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:26.687229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d576a7ab-f5ac-477c-8cc2-4d175a46ba72 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.183129 Aug 29 20:14:26.687788 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 61/118] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:26 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:26.769268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:26.769865 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:26.775634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.776110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.776533 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.777215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.777662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.778075 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.792987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:26.793590 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:26.799955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.801477 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.801887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.802587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:26.803298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:26.803741 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:26.978118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:26.981129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:26.986390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7f3e8f48-8ad7-470a-a01b-687bd9921c58 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.220876 Aug 29 20:14:26.986966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 58/119] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:26 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:26.989187 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c40caaa9-a2c9-4c21-ac9e-e203a60e1b26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.199969 Aug 29 20:14:26.989724 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 62/120] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:26 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:27.573778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:27.574379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:27.581322 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:27.581801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:27.582237 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:27.582916 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:27.583402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:27.583822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:27.712173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:27.712769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:27.713368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:27.719111 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:27.719700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:27.720119 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:27.720830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:27.721277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:27.721390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ad935aa7-d339-452a-ba02-4dd6fd90f2a3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.151373 Aug 29 20:14:27.721692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:27.722107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 59/121] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:27 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:27.847271 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:27.855428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:27.857374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:27.858887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b03b6cf5-b25b-4915-aa9b-2d43c0f9559d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.150402 Aug 29 20:14:27.859634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 63/122] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:27 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:28.007822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:28.008430 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:28.009382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:28.010068 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:28.014394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.014917 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.015394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.016066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.016162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.016543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.016640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.016974 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.017109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.017660 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.018104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.018516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.203930 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:28.210549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:28.211655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bb448c59-5ce6-418e-99a6-a362d66ace18 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.207683 Aug 29 20:14:28.212229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 60/123] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:28 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:28.219019 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc2ca196-da77-415c-9e9d-45d68c8f6263 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.213307 Aug 29 20:14:28.219752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 64/124] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:28 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:28.741566 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:28.742166 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:28.748600 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.749081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.749506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.750186 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.750633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.751050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.884505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:28.884505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:28.892731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.893292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.893792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.894861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:28.899584 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:28.899866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:28.900262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:28.909692 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-471e15a3-c94a-46c6-9ed2-181e5709acbf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.171781 Aug 29 20:14:28.910445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 61/125] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:28 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:29.043990 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:29.053249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:29.054680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:29.055817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b70474c2-a787-4406-87ee-fd80ace1910b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.177572 Aug 29 20:14:29.056373 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 65/126] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:28 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:29.233234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:29.233837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:29.239819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.239979 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:29.240304 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.240400 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:29.240737 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:29.241417 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.241868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.242289 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:29.246182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.246654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.247131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:29.248038 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.248692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.249081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:29.437069 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:29.441751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:29.445480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9f8f8fc-ba27-40ca-8775-5af45f4e3e25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.209483 Aug 29 20:14:29.449117 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 66/127] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:29 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:29.449798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b7f5df9d-ad64-4424-b4cb-83e7a1d9eb41 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.220352 Aug 29 20:14:29.450359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 62/128] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:29 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:29.930439 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:29.931064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:29.938127 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.938603 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.939029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:29.939743 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:29.940188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:29.940597 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.083119 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:30.084687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:30.099687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.100280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.100718 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.101411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.101963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.102385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.142749 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:30.154763 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d899f315-6283-4231-b683-d38b74b87639 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.228028 Aug 29 20:14:30.155824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 67/129] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:29 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:30.254682 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:30.264129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:30.265941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:30.267160 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8ef9c37e-caac-451a-a3a8-07f51ea0c39a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.188256 Aug 29 20:14:30.267903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 63/130] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:30 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:30.470884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:30.471402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:30.471514 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:30.472002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:30.478183 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.478308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.478656 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.478752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.479141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.479436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.479965 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.480304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:30.480413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.480746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:30.480940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.481291 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:30.685147 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:30.688452 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:30.688686 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:30.694470 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28c4b26a-14d8-4e5a-9acc-b7da596485b8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.228417 Aug 29 20:14:30.696492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-37e7b07d-fbde-418d-bcd8-0c698c740b24 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.229141 Aug 29 20:14:30.697221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 64/131] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:30 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:30.708137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 68/132] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:30 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:31.180232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:31.180891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:31.187047 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.187569 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.187996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.188835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.189291 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.189706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.299698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:31.300972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:31.307287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.308242 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.308888 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.309821 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.310592 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.311273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.355125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:31.364795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f3afd5a4-8b75-490f-8f66-445c39976fcc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.192473 Aug 29 20:14:31.365938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 65/133] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:31 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:31.471612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:31.480100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:31.481461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:31.482619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3022dc88-ea80-496a-a4b3-e5756e10b721 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.187354 Aug 29 20:14:31.483197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 69/134] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:31 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:31.717351 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:31.718472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:31.719654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:31.720260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:31.726318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.726796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.727376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.727671 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.728421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.728634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.729658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.729761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.729843 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.729935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:31.730670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:31.731593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:31.992526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:31.996904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:32.003127 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7b4f199d-db02-450a-a122-258d2222f115 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.290204 Aug 29 20:14:32.003760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 66/135] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:31 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:32.004886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1f551a4-8f39-477d-b0bc-3de95d00fd96 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.289046 Aug 29 20:14:32.019246 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 70/136] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:31 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:32.386081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:32.388752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:32.394111 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:32.394542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:32.394986 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:32.395779 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:32.396375 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:32.396802 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:32.509796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:32.511143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:32.518716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:32.519479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:32.520093 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:32.521101 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:32.521850 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:32.522423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:32.565725 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:32.577668 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b6b6f2f1-94b0-4aaf-94b2-fae69927b484 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.196022 Aug 29 20:14:32.579262 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 67/137] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:32 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:32.675467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:32.683715 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:32.685875 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:32.687227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bba730b0-9e34-4625-be48-21d4c54280c7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.185229 Aug 29 20:14:32.687925 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 71/138] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:32 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:33.025763 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:33.026365 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:33.029896 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:33.030643 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:33.038529 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.039227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.041671 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.042056 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.042691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.043702 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.045129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.045869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.046423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.046598 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.047217 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.047765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.272613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:33.275108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:33.284057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2016beaa-e3a4-4371-bff9-46d8b95db9a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.258908 Aug 29 20:14:33.284631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 72/139] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:33 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:33.288819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e93b6e82-fc1c-4c64-82cf-57aaa860e43a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.266878 Aug 29 20:14:33.289428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 68/140] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:33 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:33.482092 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a301f0c5-bb23-4434-8560-4f001e080c13 req-6f4f3a88-40e8-4622-8e02-7a231320fb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee34ea9-ae27-4156-8f42-17d06286bebe", "name": "network-vif-plugged", "status": "completed", "tag": "a973a1f7-934c-4d30-ac16-cec9f03a8bfe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:33.497542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a301f0c5-bb23-4434-8560-4f001e080c13 req-6f4f3a88-40e8-4622-8e02-7a231320fb85 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.498285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a301f0c5-bb23-4434-8560-4f001e080c13 req-6f4f3a88-40e8-4622-8e02-7a231320fb85 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.499429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a301f0c5-bb23-4434-8560-4f001e080c13 req-6f4f3a88-40e8-4622-8e02-7a231320fb85 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.529781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a301f0c5-bb23-4434-8560-4f001e080c13 req-6f4f3a88-40e8-4622-8e02-7a231320fb85 service nova] Creating event network-vif-plugged:a973a1f7-934c-4d30-ac16-cec9f03a8bfe for instance 2ee34ea9-ae27-4156-8f42-17d06286bebe on hv-cinder-85426 Aug 29 20:14:33.545992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a301f0c5-bb23-4434-8560-4f001e080c13 req-6f4f3a88-40e8-4622-8e02-7a231320fb85 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065072 Aug 29 20:14:33.546652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 73/141] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:33.605348 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:33.607242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:33.616897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.617885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.618520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.619520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.620335 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.621061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.710802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:33.712453 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:33.734599 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.737184 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.738360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.740028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:33.741228 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:33.742817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:33.874509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:33.883202 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9f6c7ae9-b33c-491d-8093-0319025780bb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1371 microversion: 2.1 time: 0.286327 Aug 29 20:14:33.884841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 69/142] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:33 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:33.931338 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:33.942693 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:33.944771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:33.948238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b329325-b55e-4094-8f9f-f1f45f9ee490 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.241379 Aug 29 20:14:33.951128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 74/143] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:33 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:34.306084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:34.307070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:34.313440 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:34.313593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.314040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:34.314135 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.314628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.315432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.316113 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.316755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.320194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.320830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.321427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.322806 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.323538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.324130 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.528736 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:34.536050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6e9e756c-d6ef-4987-9ecf-7721d86dae9b tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.233799 Aug 29 20:14:34.536628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 70/144] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:34 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:34.572737 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:34.581819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be817490-6cb3-4c67-b28c-43a304377692 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.272785 Aug 29 20:14:34.582393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 75/145] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:34 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:34.905103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:34.905704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:34.911518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.912021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.912446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.913125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.913590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.913985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.975529 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:34.976178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:34.982713 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.983224 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.983651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:34.984387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:34.984833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:34.985249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.088647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:35.097142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-619dd379-31d0-4c18-8cc7-fd536496901f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1561 microversion: 2.1 time: 0.196814 Aug 29 20:14:35.098267 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 71/146] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:34 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1561 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:35.128460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:35.128943 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:35.134726 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:35.135232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:35.135661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.136338 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:35.136786 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:35.137205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.145373 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:35.154341 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:35.155826 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:35.156947 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1d85f38-db38-4b57-bca9-517ade4a5311 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.185500 Aug 29 20:14:35.157542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 76/147] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:34 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:14:35.252729 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-dd214910-338a-4798-b0d2-6b150e7cec89 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128072 Aug 29 20:14:35.253515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 72/148] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:14:35 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:14:35.557288 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:35.558021 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:35.563999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:35.564477 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:35.564911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.565741 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:35.566034 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:35.566467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.575715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-34136a08-6519-4061-aa1a-7edd47cb9751 req-4e9cb565-d625-4c9c-a6ff-1069c769215e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ca18a5-9e7c-494f-ab36-244c102fcd9c", "name": "network-vif-plugged", "status": "completed", "tag": "392323eb-c6ee-4e5d-b1fc-f753dc8fa07f"}, {"server_uuid": "489e0150-911d-4e6b-9bd1-15903a23dc3c", "name": "network-vif-plugged", "status": "completed", "tag": "882553ff-4ac3-48cc-9d4b-77e541c96a98"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:35.586388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-34136a08-6519-4061-aa1a-7edd47cb9751 req-4e9cb565-d625-4c9c-a6ff-1069c769215e service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:35.586862 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-34136a08-6519-4061-aa1a-7edd47cb9751 req-4e9cb565-d625-4c9c-a6ff-1069c769215e service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:35.587312 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-34136a08-6519-4061-aa1a-7edd47cb9751 req-4e9cb565-d625-4c9c-a6ff-1069c769215e service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.591675 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=100 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:35.602358 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-34136a08-6519-4061-aa1a-7edd47cb9751 req-4e9cb565-d625-4c9c-a6ff-1069c769215e service nova] Creating event network-vif-plugged:392323eb-c6ee-4e5d-b1fc-f753dc8fa07f for instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c on hv-cinder-85426 Aug 29 20:14:35.602858 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-34136a08-6519-4061-aa1a-7edd47cb9751 req-4e9cb565-d625-4c9c-a6ff-1069c769215e service nova] Creating event network-vif-plugged:882553ff-4ac3-48cc-9d4b-77e541c96a98 for instance 489e0150-911d-4e6b-9bd1-15903a23dc3c on hv-cinder-85426 Aug 29 20:14:35.612645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-34136a08-6519-4061-aa1a-7edd47cb9751 req-4e9cb565-d625-4c9c-a6ff-1069c769215e service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040537 Aug 29 20:14:35.613719 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 73/149] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:35.619188 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:35.619890 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:35.626537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:35.627023 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:35.627479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.628173 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:35.628628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:35.629050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:35.752182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:35.760980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3537f3f9-dad0-432c-9bf4-29e29bc72219 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.207471 Aug 29 20:14:35.762207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 77/150] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:35 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:35.796129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:35.803887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b72c0fc9-1bc9-4524-9faf-b4e4f92e8d5f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.188985 Aug 29 20:14:35.804479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 74/151] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:35 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:36.180134 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:36.180772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:36.188314 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.188880 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.189318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.190015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.190483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.190907 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.325784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:36.334459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:36.335911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:36.336999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-159b7367-870e-496d-bc4d-566361f6bcde tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.160739 Aug 29 20:14:36.337551 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 78/152] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:36 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:36.592714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-2e59706b-9517-486e-95e3-ce9a456b3078 req-120132a5-b422-4265-ab1d-581569a71402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a078027c-0fda-486c-9f40-ac527c610a4c", "tag": "42fa43bf-f892-46be-b812-4b6d81b4ea2d"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:36.602023 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-2e59706b-9517-486e-95e3-ce9a456b3078 req-120132a5-b422-4265-ab1d-581569a71402 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.602567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-2e59706b-9517-486e-95e3-ce9a456b3078 req-120132a5-b422-4265-ab1d-581569a71402 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.603064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-2e59706b-9517-486e-95e3-ce9a456b3078 req-120132a5-b422-4265-ab1d-581569a71402 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.615867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-2e59706b-9517-486e-95e3-ce9a456b3078 req-120132a5-b422-4265-ab1d-581569a71402 service nova] Creating event network-changed:42fa43bf-f892-46be-b812-4b6d81b4ea2d for instance a078027c-0fda-486c-9f40-ac527c610a4c on hv-cinder-85426 Aug 29 20:14:36.620731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-2e59706b-9517-486e-95e3-ce9a456b3078 req-120132a5-b422-4265-ab1d-581569a71402 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031643 Aug 29 20:14:36.621316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 75/153] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:36.782286 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:36.782793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:36.788702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.789181 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.789608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.790291 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.790743 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.791184 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.825053 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:36.825918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:36.832283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.832759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.833184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.833870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:36.834476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:36.835167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:36.990173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:36.998935 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-074c5c98-d815-45d9-b927-e5ba05b271ee tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.220509 Aug 29 20:14:37.000164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 79/154] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:36 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:37.018004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:37.026057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-974df8f8-9bd3-4b60-bf12-35739b79b2e5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.205456 Aug 29 20:14:37.026628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 76/155] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:36 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:37.360301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:37.360894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:37.370672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:37.371307 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:37.371776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:37.372546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:37.372921 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:37.373341 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:37.509507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:37.518371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:37.519916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:37.521015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd66c75a-ce51-43c7-84dd-59d61ec52407 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.165842 Aug 29 20:14:37.521578 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 80/156] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:37 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:38.020053 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:38.020664 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:38.026678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.027198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.027631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.028320 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.028770 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.029365 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.050785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:38.051559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:38.058451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.071268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.071268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.071268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.071848 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.072230 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.203160 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.213518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-25600473-74de-410d-ba33-66f962c38133 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.197146 Aug 29 20:14:38.214666 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 77/157] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:38 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:38.249668 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.260543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea76914c-7ea5-453e-a321-31beae5bea7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.216568 Aug 29 20:14:38.275635 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 81/158] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:38 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:38.544559 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:38.545568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:38.551986 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.552469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.552894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.553814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:38.554268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:38.554696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:38.710104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.729456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.731879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:38.735110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ab45a66d-34e5-462a-bcbd-23506cc00a5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.193835 Aug 29 20:14:38.735830 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 78/159] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:38 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:39.235218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:39.235910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:39.242005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.242568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.243092 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:39.243797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.244253 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.244678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:39.281976 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:39.282580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:39.289328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.289840 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.291938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:39.292733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.293635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.294316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:39.488727 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:39.491218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:39.505733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1f4fc337-b1f1-4d63-b309-f042fad85517 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.227512 Aug 29 20:14:39.506298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f095de37-9545-4cca-84d6-d45f88b2590a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.272106 Aug 29 20:14:39.507180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 82/160] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:39 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:39.517319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 79/161] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:39 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:39.758105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:39.758840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:39.765874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.769762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.771059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:39.772262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:39.773128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:39.773804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.101885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.110004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.111473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.112564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9358fe24-0a97-481b-b484-9c5bd2921161 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1411 microversion: 2.20 time: 0.358692 Aug 29 20:14:40.113122 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 83/162] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:39 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1411 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:40.533228 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:40.534270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:40.539069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=95 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:40.540053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:40.543523 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:40.546149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.547005 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.547795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.549044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.549456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=98 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:40.549808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.550345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.554390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.555208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.556020 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.557015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:40.557688 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:40.558340 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:40.766541 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.769745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:40.775927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-021edcde-bbcf-4ca3-9d4a-7a2e923edf4a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.251006 Aug 29 20:14:40.776730 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 80/163] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:40 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:40.778681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ad40641-c693-49e7-a4f3-5de74ce6d133 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1326 microversion: 2.1 time: 0.244861 Aug 29 20:14:40.779363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 84/164] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:40 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1326 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:41.136496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:41.137938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:41.144421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.144912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.145351 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.146050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.146507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.146929 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.310580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.319071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.320650 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:41.321864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bd45d542-d153-4928-acbb-14a7ee3d7728 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1602 microversion: 2.20 time: 0.189607 Aug 29 20:14:41.322672 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 81/165] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:14:41 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1602 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:14:41.346578 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:41.346993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:41.355161 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.355778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.356408 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.357179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.357829 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.358320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.479487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-821df838-251b-4c64-854b-4a08168e4c7b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.136875 Aug 29 20:14:41.480243 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 85/166] 10.222.0.121 () {60 vars in 1321 bytes} [Mon Aug 29 20:14:41 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:14:41.802284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:41.803896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:41.812003 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.812810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.813203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:41.813964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:41.814247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.815132 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.816036 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.816872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.821316 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.822125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.822818 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.824060 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:41.825397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:41.826101 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:41.853066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:42.055401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:42.058535 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:42.065104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a38603bc-9089-413d-abba-b855c94b074b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1519 microversion: 2.1 time: 0.268561 Aug 29 20:14:42.066375 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e88d44eb-2c51-4f89-a2d7-993a55fea1d4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.270269 Aug 29 20:14:42.066939 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 82/167] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:41 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:42.080371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 86/168] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:41 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:42.087609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:42.090162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:42.096778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.097259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.097678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.098538 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.098988 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.099452 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.123130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'flavor' on Instance uuid 489e0150-911d-4e6b-9bd1-15903a23dc3c {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:14:42.250822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-69f318bd-5a87-405a-a362-6d2d845b4cec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c/action" status: 200 len: 32 microversion: 2.1 time: 0.167141 Aug 29 20:14:42.251542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 83/169] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:14:42 2022] POST /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:14:42.260830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:42.261435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:42.267556 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.268042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.268476 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.269158 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.269599 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.270255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.488780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:42.500289 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50f1547d-202f-4a50-bc6d-897965d8607b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.243094 Aug 29 20:14:42.500884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 87/170] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:42 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:42.606669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-03a950ca-548a-402e-a10c-34a150692e96 req-e576c7af-8715-460e-b4cd-de0469571128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee34ea9-ae27-4156-8f42-17d06286bebe", "tag": "a973a1f7-934c-4d30-ac16-cec9f03a8bfe"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:42.619122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-03a950ca-548a-402e-a10c-34a150692e96 req-e576c7af-8715-460e-b4cd-de0469571128 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:42.619720 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-03a950ca-548a-402e-a10c-34a150692e96 req-e576c7af-8715-460e-b4cd-de0469571128 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:42.620372 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-03a950ca-548a-402e-a10c-34a150692e96 req-e576c7af-8715-460e-b4cd-de0469571128 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:42.632567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-03a950ca-548a-402e-a10c-34a150692e96 req-e576c7af-8715-460e-b4cd-de0469571128 service nova] Creating event network-changed:a973a1f7-934c-4d30-ac16-cec9f03a8bfe for instance 2ee34ea9-ae27-4156-8f42-17d06286bebe on hv-cinder-85426 Aug 29 20:14:42.638341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-03a950ca-548a-402e-a10c-34a150692e96 req-e576c7af-8715-460e-b4cd-de0469571128 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036373 Aug 29 20:14:42.639246 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 84/171] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:43.087989 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:43.089524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:43.095763 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:43.096248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:43.096856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:43.097739 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:43.098194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:43.098977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:43.246717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:43.255488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43d51e87-fed3-453f-84cd-2cf1fd3ac510 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.171749 Aug 29 20:14:43.256246 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 88/172] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:43 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:43.522128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:43.522830 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:43.532900 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:43.533461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:43.533996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:43.534599 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:43.535061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:43.535565 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:43.721363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:43.729988 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-36837cd9-27f8-4bcf-88aa-c7fe0616b589 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.212233 Aug 29 20:14:43.731749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 85/173] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:43 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:44.275619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:44.276258 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:44.283205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.283697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.284135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.284828 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.285286 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.285712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.418626 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:44.426864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50f8f318-3e9b-4e96-88bc-15b8863eadaa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.155019 Aug 29 20:14:44.427451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 89/174] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:44 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:44.755804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:44.756478 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:44.763381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.763869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.764309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.765005 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:44.765463 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:44.765886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:44.908906 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:44.917929 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-46f192bb-cbc0-4225-948b-4e6da532d9a8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.166334 Aug 29 20:14:44.918880 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 86/175] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:44 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:45.448035 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:45.449255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:45.455336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.455822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.456258 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.456962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.457401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.457821 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.592106 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:45.599780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3d5b6f4-ace6-4922-9c69-e8e29aaa906e tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.155628 Aug 29 20:14:45.600346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 90/176] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:45 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:45.939580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:45.940117 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:45.946233 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.946751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.947218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:45.947902 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:45.948350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:45.948764 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.076559 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:46.084403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-64ca45df-356e-4cbd-bc70-4c6714691ef9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.148659 Aug 29 20:14:46.084963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 87/177] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:45 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:46.621249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:46.621851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:46.627770 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.628247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.628675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.629352 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:46.629801 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:46.630216 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:46.760908 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:46.769035 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7ea3355-1c2f-41e4-adeb-c1a2468212aa tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.152131 Aug 29 20:14:46.769597 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 91/178] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:46 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:47.105015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:47.105613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:47.111785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:47.112263 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:47.112691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.113366 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:47.113815 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:47.114229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.241467 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:47.249441 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ffb97d76-6fbd-4f44-acea-933956c81bc6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.148325 Aug 29 20:14:47.250015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 88/179] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:47 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:47.790029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:47.790863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:47.797880 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:47.798585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:47.799286 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.802251 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:47.802784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:47.803443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:47.972916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:47.981382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b205d6d-d7a3-4453-8770-46a2f786f8b8 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1319 microversion: 2.1 time: 0.195549 Aug 29 20:14:47.983263 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 92/180] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:47 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:48.271441 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:48.272050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:48.279387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.280127 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.280769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.281660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:48.282299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:48.282905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:48.507965 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:48.511999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:48.517340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-74c48d94-fa50-44ac-8c82-38bac17fb3e3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.249528 Aug 29 20:14:48.518526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 89/181] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:48 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:49.016802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:49.017372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:49.032098 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.032677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.033145 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:49.033972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.034574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.035159 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:49.207652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:49.219178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ece5e77d-1c4d-4035-84c5-0512292655da tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1506 microversion: 2.1 time: 0.206973 Aug 29 20:14:49.220255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 93/182] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:49 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:49.552471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:49.557070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:49.583681 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.584615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.585346 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:49.589155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:49.590031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:49.590827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:49.975131 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:49.985497 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-870baa6c-f52c-4952-9395-eb26490fddaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.447275 Aug 29 20:14:49.986796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 90/183] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:49 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:50.967859 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02708cb8-0a4f-43a9-b2d9-0521c0cc70cd"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:50.970746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:50.978927 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:50.981088 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:50.981992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:50.982982 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:50.983836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:50.984478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:51.006367 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:51.007553 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:51.018636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:51.019546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:51.022536 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:51.024559 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:51.025772 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:51.027972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:51.366191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:51.373324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fd787553-4c12-460e-b70f-12c0175f4d14 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.369444 Aug 29 20:14:51.380328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 91/184] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:51 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:51.528073 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8211d99-e43f-4fd0-a18d-0445488c0ca6 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "POST /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564199 Aug 29 20:14:51.531176 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 94/185] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:14:50 2022] POST /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:14:52.403587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:52.404355 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:52.410687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:52.411017 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:52.411476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:52.412167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:52.412625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:52.413060 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:52.624999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:52.633617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-29ab5ea9-be80-41e8-94ba-bc0b2176d72f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.234430 Aug 29 20:14:52.634299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 92/186] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:52 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:53.121708 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-250605429", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "networks": [{"uuid": "d480d6d6-eb3f-49d3-82af-4a9e1b000836"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:14:53.192697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] validate_networks() for [('d480d6d6-eb3f-49d3-82af-4a9e1b000836', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:14:53.656500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:53.657104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:53.665189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.665897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.666370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.667678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.668138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.668885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.681535 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:14:53.681954 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:14:53.682749 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:14:53.683400 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:14:53.683820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:14:53.694498 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.694983 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.695577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.696300 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:53.696758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:53.697170 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:53.717946 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Getting quotas for project 3135b1db5b604d55ad55622977cbae5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:14:53.723195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Getting quotas for user 5c3b898f6267460896913b7c31bfca40 and project 3135b1db5b604d55ad55622977cbae5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:14:53.738600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:14:53.741113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:14:53.810031 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d366dab5-cb5e-45f5-911d-d634d03467cf tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.694260 Aug 29 20:14:53.814614 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 95/187] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:14:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:14:53.840036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c9faa31-9219-432e-bcbe-d176e3fb2190 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:53.841499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c9faa31-9219-432e-bcbe-d176e3fb2190 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:53.897982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:53.908448 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4d875e59-e097-4cfd-a405-cefca1e32180 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.256238 Aug 29 20:14:53.909204 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 93/188] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:53 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:53.944887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c9faa31-9219-432e-bcbe-d176e3fb2190 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:53.954087 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c9faa31-9219-432e-bcbe-d176e3fb2190 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1217 microversion: 2.1 time: 0.132027 Aug 29 20:14:53.956137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 96/189] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:53 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:54.930365 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:54.931530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:54.938315 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.939004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.939607 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.940478 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.940920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.941486 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.976160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:54.977599 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:54.989871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.990604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.991400 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:54.992339 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:54.992990 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:54.993569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:55.109754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:55.122361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dcba0c36-7668-495d-84c5-82a1cd5f1b07 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1269 microversion: 2.1 time: 0.149734 Aug 29 20:14:55.123557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 97/190] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:54 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:55.147907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:55.156476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-465fec53-30c7-46e2-8cb1-ef4392981c7e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.230338 Aug 29 20:14:55.157054 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 94/191] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:54 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:56.144829 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:56.145566 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:56.155434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.156290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.156914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:56.158372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.159031 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.159855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:56.182200 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:56.183536 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:56.190730 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.191585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.192218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:56.193081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:56.193674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:56.194295 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:56.267024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:56.277918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2bae0b43-1aa0-4157-9e0f-683d085e658e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1275 microversion: 2.1 time: 0.137634 Aug 29 20:14:56.278697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 98/192] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:56 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:56.388508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:56.396445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-12b4650a-d6d0-42ef-9fbf-68c557965779 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.219477 Aug 29 20:14:56.397211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 95/193] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:56 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:57.298836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:57.299569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:57.307209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.307710 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.308135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.308815 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.309261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.309673 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.418807 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:57.420381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:57.427443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.428134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.428982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.429988 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:57.430598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:57.431198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:57.442883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:57.452169 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f79b7d34-9395-42c9-813a-3e7b453a8ff4 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.157292 Aug 29 20:14:57.452992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 99/194] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:57 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:57.564338 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:57.572556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d20658c2-5416-4107-80d6-42b7d5540dbe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.158458 Aug 29 20:14:57.573630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 96/195] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:57 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:14:58.472831 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:58.473436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:58.480496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.480961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.481390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.482084 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.482527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.482941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.593540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:58.594341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:58.600252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.600727 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.601162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.601839 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:58.602285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:58.602698 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:58.613900 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:58.622497 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e73928f-5345-4211-bbd0-1abeb2f706e0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.153437 Aug 29 20:14:58.623177 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 100/196] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:58 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:58.730058 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:58.738002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-27f868f8-348e-442a-8813-5d10cf06b0b1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.148256 Aug 29 20:14:58.738567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 97/197] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:58 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:59.642541 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:59.643161 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:59.649515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:59.649987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:59.650420 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:59.651122 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:59.651573 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:59.651985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:59.758149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:14:59.758755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:14:59.765996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:59.766479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:59.766906 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:59.767645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:14:59.768099 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:14:59.768531 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:14:59.779299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:59.787098 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26509d27-479e-4d75-9f3a-a9ec0a15994d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.148336 Aug 29 20:14:59.787673 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 101/198] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:59 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:14:59.910891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:14:59.920082 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-36e4fd2d-11c9-45c0-83d5-a8cb6d85665b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.166197 Aug 29 20:14:59.920643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 98/199] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:14:59 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:00.433529 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f5a191f9-fe25-4940-badd-9374812065fd req-836fb7ee-2fc6-400e-9474-de7ba875f84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c545409-6cc5-40dd-ae30-f4c5fc7f840f", "tag": "c045a635-9892-42e4-b346-cf9c8e15c1d4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:00.443827 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f5a191f9-fe25-4940-badd-9374812065fd req-836fb7ee-2fc6-400e-9474-de7ba875f84b service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:00.444739 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f5a191f9-fe25-4940-badd-9374812065fd req-836fb7ee-2fc6-400e-9474-de7ba875f84b service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:00.445320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f5a191f9-fe25-4940-badd-9374812065fd req-836fb7ee-2fc6-400e-9474-de7ba875f84b service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:00.457352 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f5a191f9-fe25-4940-badd-9374812065fd req-836fb7ee-2fc6-400e-9474-de7ba875f84b service nova] Creating event network-changed:c045a635-9892-42e4-b346-cf9c8e15c1d4 for instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f on hv-cinder-85426 Aug 29 20:15:00.463459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f5a191f9-fe25-4940-badd-9374812065fd req-836fb7ee-2fc6-400e-9474-de7ba875f84b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033149 Aug 29 20:15:00.464684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 102/200] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:00.808153 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:00.808666 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:00.814724 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:00.815239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:00.815679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:00.816367 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:00.816827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:00.817244 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:00.942810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:00.944393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:00.952508 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:00.953157 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:00.953770 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:00.954702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:00.955365 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:00.956060 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:00.989054 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:01.000379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ab70318f-6385-4d24-aa6a-c44df18bbe2b tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.197209 Aug 29 20:15:01.001953 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 99/201] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:00 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:01.264937 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:01.273947 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5b4bade-89ea-4736-80fc-aa46a3350a39 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.336563 Aug 29 20:15:01.274523 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 103/202] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:00 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:02.022515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:02.023016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:02.029311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:02.029785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:02.030211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:02.030910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:02.031387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:02.031805 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:02.158822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:02.166934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-eea9b983-cc1e-42f9-bb09-9a0a7258dcdd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.148312 Aug 29 20:15:02.167782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 100/203] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:02 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:02.294255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:02.294850 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:02.301912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:02.302413 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:02.303058 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:02.303846 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:02.304326 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:02.304773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:02.310168 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:02.513302 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:02.524805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5417957d-241a-47b8-b295-c6cc668d0ecd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.235059 Aug 29 20:15:02.525944 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 104/204] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:02 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:03.189229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:03.190292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:03.197641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.199692 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.200362 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.201158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.201767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.202365 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.429648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:03.445973 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-589b05bf-8f54-43bf-9cc0-0b51cac42e9a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.261229 Aug 29 20:15:03.464012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 101/205] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:03 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:03.556977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:03.557801 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:03.581214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:03.581684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:03.585115 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.586125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.586319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.587181 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.588367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.589213 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.590949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.591651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.592238 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.593234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.593996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.594611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.626609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:15:03.715836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:03.737523 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e4ddafc4-ded7-40dd-b156-633a91475dd7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "DELETE /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 204 len: 0 microversion: 2.1 time: 0.159077 Aug 29 20:15:03.738586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 102/206] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:15:03 2022] DELETE /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:15:03.752697 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:03.753866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:03.776572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.780678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.782284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.783097 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:03.784507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:03.784960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:03.819633 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:03.829448 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b849e20-2811-4724-be5b-79980321af5d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.284910 Aug 29 20:15:03.839307 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 105/207] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:03 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:03.957035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:03.966791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6c4d9f06-e43f-427a-bda5-1c10424f5c85 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1558 microversion: 2.1 time: 0.222502 Aug 29 20:15:03.967457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 103/208] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:03 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:04.471704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:04.472471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:04.475491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:04.479430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:04.479922 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:04.480359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:04.481048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:04.481502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:04.481919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:04.622209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:04.630969 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97339da8-a489-46b2-a170-f96d37afbba0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.163045 Aug 29 20:15:04.631637 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 106/209] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:04 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:04.856569 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:04.857293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:04.864537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:04.865055 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:04.865913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:04.867030 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:04.867517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:04.868002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:04.988189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:04.988796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:04.997063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.003451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.003997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.004910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.005382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.005810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.034734 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:05.043039 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:05.048822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1a2022ed-ff2b-49ee-bee7-c40362f8dab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.197828 Aug 29 20:15:05.049396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 104/210] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:04 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:05.177945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:05.186649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-716672b5-ffe1-4efe-9d94-986076e64fa4 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1558 microversion: 2.1 time: 0.202153 Aug 29 20:15:05.187250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 107/211] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:04 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:05.652500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:05.653102 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:05.666593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.667876 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.668620 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.669588 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:05.670198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:05.671397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:05.844923 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:05.860706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7f3f263d-5fa1-46c9-b179-e724c596c007 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.213198 Aug 29 20:15:05.861277 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 105/212] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:05 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:06.074172 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:06.075500 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:06.082011 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.082595 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.083121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.083820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.084268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.084680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.208379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:06.209181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:06.217587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.218410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.219191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.220103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.220902 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.221541 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.256064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:06.266587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56365107-f916-49fa-8194-e648a1ba00fe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.197776 Aug 29 20:15:06.267513 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 108/213] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:06 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:06.397252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:06.406250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6f11919c-0b2a-4dd8-b574-311139b7e9a1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1558 microversion: 2.1 time: 0.201960 Aug 29 20:15:06.406810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 106/214] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:06 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:06.881466 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:06.882059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:06.888738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.889185 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.889614 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:06.890298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:06.891201 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:06.891201 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.019495 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:07.027053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b34c95a5-edc5-4499-9273-2ccd6360cb5a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.149420 Aug 29 20:15:07.027639 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 109/215] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:06 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:07.288565 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:07.289336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:07.296056 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:07.296617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:07.297033 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.297842 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:07.298466 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:07.298936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.436232 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:07.436844 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:07.441445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:07.444136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:07.444695 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:07.445462 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.446219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:07.446733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:07.447221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.449937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a3be5371-e951-4178-9d64-9c607e963172 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.165839 Aug 29 20:15:07.450581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 107/216] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:07 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:07.583911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:07.592725 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eaf5b9ce-c6e4-4a03-a3ec-d85c3ff5b7db tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1558 microversion: 2.1 time: 0.160899 Aug 29 20:15:07.593703 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 110/217] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:07 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:07.689014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-a7ef3cfa-f49f-4182-9e47-0df3c1eca008 req-bfd29839-a529-4fb8-a1ef-86433e87c832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c545409-6cc5-40dd-ae30-f4c5fc7f840f", "name": "network-vif-plugged", "status": "completed", "tag": "c045a635-9892-42e4-b346-cf9c8e15c1d4"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:07.701152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a7ef3cfa-f49f-4182-9e47-0df3c1eca008 req-bfd29839-a529-4fb8-a1ef-86433e87c832 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:07.702014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a7ef3cfa-f49f-4182-9e47-0df3c1eca008 req-bfd29839-a529-4fb8-a1ef-86433e87c832 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:07.702443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a7ef3cfa-f49f-4182-9e47-0df3c1eca008 req-bfd29839-a529-4fb8-a1ef-86433e87c832 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:07.726969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-a7ef3cfa-f49f-4182-9e47-0df3c1eca008 req-bfd29839-a529-4fb8-a1ef-86433e87c832 service nova] Creating event network-vif-plugged:c045a635-9892-42e4-b346-cf9c8e15c1d4 for instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f on hv-cinder-85426 Aug 29 20:15:07.741743 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-a7ef3cfa-f49f-4182-9e47-0df3c1eca008 req-bfd29839-a529-4fb8-a1ef-86433e87c832 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050138 Aug 29 20:15:07.742335 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 108/218] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:08.047493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:08.048160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:08.055310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.056054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.056488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.057229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.057903 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.058324 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.079276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-cea0fc2c-1ba7-4ef9-ad6b-839143ad522f req-cd13b2d7-4346-4189-a216-1aa2c272643d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ca18a5-9e7c-494f-ab36-244c102fcd9c", "name": "network-vif-deleted", "tag": "392323eb-c6ee-4e5d-b1fc-f753dc8fa07f"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:08.108671 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-cea0fc2c-1ba7-4ef9-ad6b-839143ad522f req-cd13b2d7-4346-4189-a216-1aa2c272643d service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.109223 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-cea0fc2c-1ba7-4ef9-ad6b-839143ad522f req-cd13b2d7-4346-4189-a216-1aa2c272643d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.109661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-cea0fc2c-1ba7-4ef9-ad6b-839143ad522f req-cd13b2d7-4346-4189-a216-1aa2c272643d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.123538 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-cea0fc2c-1ba7-4ef9-ad6b-839143ad522f req-cd13b2d7-4346-4189-a216-1aa2c272643d service nova] Creating event network-vif-deleted:392323eb-c6ee-4e5d-b1fc-f753dc8fa07f for instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c on hv-cinder-85426 Aug 29 20:15:08.128606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-cea0fc2c-1ba7-4ef9-ad6b-839143ad522f req-cd13b2d7-4346-4189-a216-1aa2c272643d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053377 Aug 29 20:15:08.129294 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 109/219] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:08.228429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:08.236531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3d44bef-e5f6-4aa6-9cc7-89544736f825 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.192913 Aug 29 20:15:08.237090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 111/220] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:08 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:08.471328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:08.472062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:08.479703 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.480192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.480623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.481313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.481760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.482185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.614708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:08.618945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:08.619572 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:08.623059 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f711caf5-b710-4418-a832-ea6f1812dfc9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.155933 Aug 29 20:15:08.623666 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 110/221] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:08 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:08.626150 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.626627 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.627052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.627758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:08.628207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:08.628623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:08.689359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:08.697580 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e49dffe-882a-42d3-b044-b9937c4fb48a tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1350 microversion: 2.1 time: 0.082375 Aug 29 20:15:08.698146 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 112/222] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:08 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:09.256855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:09.257462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:09.264046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.264524 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.264957 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.265960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.266429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.266851 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.394210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:09.401957 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e276b427-3cf3-411e-8ce3-476949ce624c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.148917 Aug 29 20:15:09.402517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 111/223] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:09 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:09.643914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:09.644460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:09.650849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.651355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.651860 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.652544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.653000 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.653414 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.717714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:09.718614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:09.724498 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.724982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.725418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.726131 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:09.726581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:09.726999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:09.794788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:09.802778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5c02617c-de60-4558-9573-f0dc5bfca4ed tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1350 microversion: 2.1 time: 0.088837 Aug 29 20:15:09.803455 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 112/224] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:09 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:09.806786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:09.814425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d39859f-c84f-4c4b-a022-c5515ad5520e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.174415 Aug 29 20:15:09.815215 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 113/225] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:09 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:10.422645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:10.423245 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:10.429227 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.429699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.430123 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.430816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.431633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.431786 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.560472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:10.568383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b5e5c70c-daf2-4365-9665-aa2a0c6d5a02 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.149588 Aug 29 20:15:10.568940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 113/226] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:10 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:10.825181 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:10.825695 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:10.827988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:10.833160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.833643 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.834066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.834746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.834927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:10.835357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.835570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:10.835661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.837594 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:10.842907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.843446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.843885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.844585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:10.845042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:10.845467 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:10.911238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:10.919873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dc37d8df-c06e-4ff2-b194-dddc2f3524d7 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1350 microversion: 2.1 time: 0.099450 Aug 29 20:15:10.920443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 114/227] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:10 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:10.998262 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:11.005854 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-daec2c37-455a-4f64-a434-a69137458ef7 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.174750 Aug 29 20:15:11.006418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 114/228] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:10 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:11.589883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:11.590465 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:11.596400 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.596876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.597310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.598016 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.598467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.598879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.732355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:11.740591 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5abc31e-e035-43a3-a479-8bcccfd1f103 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.155332 Aug 29 20:15:11.741026 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 115/229] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:11 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:11.941835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:11.942445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:11.949208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.949694 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.950131 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:11.950825 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:11.951313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:11.951744 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.012122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:12.020458 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-84fd535d-57e1-484c-a61a-dd8dfb867a71 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1350 microversion: 2.1 time: 0.082496 Aug 29 20:15:12.021256 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 115/230] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:11 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:12.027795 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:12.028392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:12.035520 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.036003 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.036435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.037124 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.037576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.037996 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.180818 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:12.190825 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3434276a-8784-4e34-8d01-60a45c4ab796 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.167475 Aug 29 20:15:12.191827 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 116/231] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:12 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:12.761283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:12.762185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:12.768136 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.768623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.769091 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.769828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:12.770297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:12.770699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:12.915904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:12.923931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a44be333-b279-412d-adce-96b9d3b7aaaa tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1317 microversion: 2.1 time: 0.167383 Aug 29 20:15:12.924819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 116/232] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:12 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:13.041897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:13.042504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:13.049025 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.049510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.049946 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.050632 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.051111 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.051530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.083071 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.083575 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.084013 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.084466 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lazy-loading 'fault' on Instance uuid 87ca18a5-9e7c-494f-ab36-244c102fcd9c {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:13.127583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7303746fd134433f9ca3035a40684277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55868f6aefc34b9786ca7489fd84e9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:13.140343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d685a7b8-28be-46f5-aa44-d048a2da7012 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 200 len: 1355 microversion: 2.1 time: 0.102589 Aug 29 20:15:13.141680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 117/233] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:13 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:13.212780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:13.213392 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:13.219531 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.220100 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.220611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.221358 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.221881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.222364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.373815 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:13.381943 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d2778de8-013a-48a0-b0d1-b8e0c3afc2ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.173285 Aug 29 20:15:13.382504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 117/234] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:13 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:13.946248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:13.947201 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:13.953847 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.954365 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.954837 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:13.955509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:13.955968 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:13.956395 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.162695 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.163436 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.163985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:14.171732 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.172225 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.172652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1117366-c195-412d-8d41-fba0aa128fbc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1500 microversion: 2.1 time: 0.231354 Aug 29 20:15:14.172763 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.173344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.173571 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 118/235] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:13 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1500 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:14.174210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.174666 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.189645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] HTTP exception thrown: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Request method failure captured: Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c HTTP/1.1 Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR37bXMbsPlBscsaPV2A4aWeRcasLutaImE9As2q17vXUlMmdiwQdwMWbfDzN4l1di1grTbZIM6P9LooPTFFBdCrgX9uD_6IHdTOBiRUKbvljssgWpJHUT5ST1BNtfSXTLPXGLnbQtE4s0ed18_axZf9IOqRRh9WXAj5Xv2wbMB7RoI Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:15:14.194827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_55868f6aefc34b9786ca7489fd84e9e5", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}] Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 7303746fd134433f9ca3035a40684277 Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.196043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '87ca18a5-9e7c-494f-ab36-244c102fcd9c'} Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:14.196808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.198353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.200021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Returning 404 to user: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:14.200021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-125dc478-c827-4218-b19c-8eae36d38d06 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 404 len: 111 microversion: 2.1 time: 0.037729 Aug 29 20:15:14.200021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 118/236] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:14 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:15:14.327221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.331342 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.338361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.338955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.339481 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.340434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.340895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.341432 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.361434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] HTTP exception thrown: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Request method failure captured: Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c/os-volume_attachments HTTP/1.1 Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR37bXMbsPlBscsaPV2A4aWeRcasLutaImE9As2q17vXUlMmdiwQdwMWbfDzN4l1di1grTbZIM6P9LooPTFFBdCrgX9uD_6IHdTOBiRUKbvljssgWpJHUT5ST1BNtfSXTLPXGLnbQtE4s0ed18_axZf9IOqRRh9WXAj5Xv2wbMB7RoI Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:15:14.366165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_55868f6aefc34b9786ca7489fd84e9e5", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}] Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 7303746fd134433f9ca3035a40684277 Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.369149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'server_id': '87ca18a5-9e7c-494f-ab36-244c102fcd9c'} Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:14.369840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:14.371252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:14.372914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Returning 404 to user: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:14.372914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9dbdc7a8-e773-46ac-b4f6-a585dab85bf1 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050369 Aug 29 20:15:14.372914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 119/237] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:15:14 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:15:14.406463 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.408348 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.419146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.420139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.421304 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.422403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.422868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.423321 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.736490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.737256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.740802 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:14.750751 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.752264 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.752401 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f6a8e040-9440-47cb-9d73-809f95d9ff71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.352751 Aug 29 20:15:14.753651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.754463 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 119/238] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:14 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:14.756391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.757433 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.758404 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.801353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:15:14.827797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:14.931005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-053afe1c-4be5-448a-94ab-cc616dffa350 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 204 len: 0 microversion: 2.1 time: 0.202867 Aug 29 20:15:14.932898 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 120/239] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:15:14 2022] DELETE /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:15:14.943042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:14.943936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:14.952001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.952991 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.953573 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:14.954989 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:14.955648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:14.956233 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.330343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:15.343261 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-beae924d-935c-4ea2-9cbc-c115dfb4b26a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1506 microversion: 2.1 time: 0.405613 Aug 29 20:15:15.344120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 120/240] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:14 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:15.639555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:15.640142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:15.647496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.647987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.648419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.649888 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.650342 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.650756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.667596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] HTTP exception thrown: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Request method failure captured: Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c HTTP/1.1 Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR37bXMbsPlBscsaPV2A4aWeRcasLutaImE9As2q17vXUlMmdiwQdwMWbfDzN4l1di1grTbZIM6P9LooPTFFBdCrgX9uD_6IHdTOBiRUKbvljssgWpJHUT5ST1BNtfSXTLPXGLnbQtE4s0ed18_axZf9IOqRRh9WXAj5Xv2wbMB7RoI Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:15:15.669940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_55868f6aefc34b9786ca7489fd84e9e5", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}] Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 7303746fd134433f9ca3035a40684277 Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.671036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '87ca18a5-9e7c-494f-ab36-244c102fcd9c'} Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:15.671721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.672718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.673976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Returning 404 to user: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:15.673976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8bc9f87b-9cf4-42a3-9489-db3d3fa482a9 tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "DELETE /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 404 len: 111 microversion: 2.1 time: 0.036361 Aug 29 20:15:15.673976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 121/241] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:15:15 2022] DELETE /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:15:15.679859 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:15.680471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] [instance: 87ca18a5-9e7c-494f-ab36-244c102fcd9c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:15.686903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.687764 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.688334 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.689337 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.689922 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.690344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.707250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] HTTP exception thrown: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Request method failure captured: Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c HTTP/1.1 Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR37bXMbsPlBscsaPV2A4aWeRcasLutaImE9As2q17vXUlMmdiwQdwMWbfDzN4l1di1grTbZIM6P9LooPTFFBdCrgX9uD_6IHdTOBiRUKbvljssgWpJHUT5ST1BNtfSXTLPXGLnbQtE4s0ed18_axZf9IOqRRh9WXAj5Xv2wbMB7RoI Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:15:15.708803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_55868f6aefc34b9786ca7489fd84e9e5", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/55868f6aefc34b9786ca7489fd84e9e5"}]}] Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 55868f6aefc34b9786ca7489fd84e9e5 Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481834356 Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 7303746fd134433f9ca3035a40684277 Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-DeleteServersTestJSON-1481834356-project Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.710215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '87ca18a5-9e7c-494f-ab36-244c102fcd9c'} Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:15.711752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. Aug 29 20:15:15.713296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:15.715393 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] Returning 404 to user: Instance 87ca18a5-9e7c-494f-ab36-244c102fcd9c could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:15.716760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ef020be9-8468-4e6b-87ac-6cd2f0b1f7fb tempest-DeleteServersTestJSON-1481834356 tempest-DeleteServersTestJSON-1481834356-project] 10.222.0.121 "GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c" status: 404 len: 111 microversion: 2.1 time: 0.040768 Aug 29 20:15:15.717554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 121/242] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:15 2022] GET /compute/v2.1/servers/87ca18a5-9e7c-494f-ab36-244c102fcd9c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:15:15.776334 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:15.776962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:15.782851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.783389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.783836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:15.784535 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:15.785158 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:15.785583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.106997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:16.123483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e57fa5ab-9c38-4dcb-9b4d-b42eac03d08e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.352327 Aug 29 20:15:16.124706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 122/243] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:15 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:16.374788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:16.379462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:16.396838 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.400219 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.401226 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.402242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:16.402914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:16.403579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:16.669704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:16.686405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5041432d-d986-4d45-869c-97bd568f3a86 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1506 microversion: 2.1 time: 0.324656 Aug 29 20:15:16.688389 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 122/244] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:16 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:17.155678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:17.157351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:17.167380 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.168287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.169358 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:17.170361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.170973 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.171744 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:17.618813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:17.630385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f209e2ba-471f-4fad-bf10-da976766bb58 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.487566 Aug 29 20:15:17.644642 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 123/245] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:17 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:17.707963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:17.708578 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:17.716809 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.717212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.717648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:17.718350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:17.718804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:17.725972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.048835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:18.076333 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-948e5bd6-4810-44ac-ab99-70c18296175c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1506 microversion: 2.1 time: 0.373093 Aug 29 20:15:18.076952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 123/246] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:17 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:18.253965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1b423c58-04f5-4c52-a399-8cce6f17cac2 req-e2f2f115-dc8b-4b8a-aceb-85cf8f8476b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c545409-6cc5-40dd-ae30-f4c5fc7f840f", "name": "network-vif-deleted", "tag": "c045a635-9892-42e4-b346-cf9c8e15c1d4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:18.276437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1b423c58-04f5-4c52-a399-8cce6f17cac2 req-e2f2f115-dc8b-4b8a-aceb-85cf8f8476b9 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.281649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1b423c58-04f5-4c52-a399-8cce6f17cac2 req-e2f2f115-dc8b-4b8a-aceb-85cf8f8476b9 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.282612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1b423c58-04f5-4c52-a399-8cce6f17cac2 req-e2f2f115-dc8b-4b8a-aceb-85cf8f8476b9 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.310644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1b423c58-04f5-4c52-a399-8cce6f17cac2 req-e2f2f115-dc8b-4b8a-aceb-85cf8f8476b9 service nova] Creating event network-vif-deleted:c045a635-9892-42e4-b346-cf9c8e15c1d4 for instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f on hv-cinder-85426 Aug 29 20:15:18.326198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1b423c58-04f5-4c52-a399-8cce6f17cac2 req-e2f2f115-dc8b-4b8a-aceb-85cf8f8476b9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076771 Aug 29 20:15:18.327780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 124/247] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:18.651603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:18.652720 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:18.684545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.685105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.688106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.689154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:18.692005 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:18.698379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:18.711339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=100 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:19.040794 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:19.069931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c3638241-7814-4bd8-b227-852b29166753 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.421572 Aug 29 20:15:19.071339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 124/248] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:18 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:19.098556 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:19.099810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:19.132792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:19.133351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:19.133853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:19.134616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:19.135094 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:19.135533 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:19.204401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:19.206398 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:19.207042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:19.209758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lazy-loading 'fault' on Instance uuid 3c545409-6cc5-40dd-ae30-f4c5fc7f840f {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:19.440431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:19.459336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-931a382b-a811-4354-b2b6-6ddaed68472c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 200 len: 1307 microversion: 2.1 time: 0.364967 Aug 29 20:15:19.460456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 125/249] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:19 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:20.094120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:20.095721 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:20.103416 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.103909 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.105768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.108206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.108696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.109129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.334977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:20.345411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fa4591df-3690-41d4-a67e-b3db0a7dc870 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.254980 Aug 29 20:15:20.348026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 125/250] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:20 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:20.485783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:20.494118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: 3c545409-6cc5-40dd-ae30-f4c5fc7f840f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:20.501290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.501790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.502228 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.503499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:20.503964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:20.504391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:20.528076 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] HTTP exception thrown: Instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f could not be found. Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Request method failure captured: Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f HTTP/1.1 Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR47NozcKsQedX2mOenc7muGhRqvIpnOY2Z9FRg5YPkBqVy9oEF_7CJwGvc5GdoYx7YMQN6fw5XgSXgdHWJfer3uMtcjFvHTJQat6-qXxXC63OY_0u45t384yCq6VE0FjJHJBqVF_NV67qIdzzgJLXXfNEqZvD8PR55wLdl8RKxY-kM Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 3135b1db5b604d55ad55622977cbae5d Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesActionsTest-471433881 Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:15:20.531048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3135b1db5b604d55ad55622977cbae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3135b1db5b604d55ad55622977cbae5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3135b1db5b604d55ad55622977cbae5d", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3135b1db5b604d55ad55622977cbae5d"}]}] Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesActionsTest-471433881 Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 3135b1db5b604d55ad55622977cbae5d Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesActionsTest-471433881 Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesActionsTest-471433881-project Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 5c3b898f6267460896913b7c31bfca40 Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesActionsTest-471433881-project Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f could not be found. Aug 29 20:15:20.532458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '3c545409-6cc5-40dd-ae30-f4c5fc7f840f'} Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f could not be found. Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:20.533305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f could not be found. Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f could not be found. Aug 29 20:15:20.534539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:20.541986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Returning 404 to user: Instance 3c545409-6cc5-40dd-ae30-f4c5fc7f840f could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:20.543101 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d4e768d-9e06-455f-a1b5-91eea10131eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f" status: 404 len: 111 microversion: 2.1 time: 0.066154 Aug 29 20:15:20.544564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 126/251] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:20 2022] GET /compute/v2.1/servers/3c545409-6cc5-40dd-ae30-f4c5fc7f840f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:15:20.705676 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1753596789", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "networks": [{"uuid": "d480d6d6-eb3f-49d3-82af-4a9e1b000836"}]}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:20.806430 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] validate_networks() for [('d480d6d6-eb3f-49d3-82af-4a9e1b000836', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:15:21.369788 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:21.371126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:21.388040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.389352 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.391409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.394960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.395855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.396480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.409350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:15:21.409879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:15:21.410305 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:15:21.410714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:15:21.411201 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:15:21.428868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.429431 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.431019 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.433488 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:21.434177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:21.435319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:21.471959 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Getting quotas for project 3135b1db5b604d55ad55622977cbae5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:21.491417 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Getting quotas for user 5c3b898f6267460896913b7c31bfca40 and project 3135b1db5b604d55ad55622977cbae5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:21.504887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:15:21.508846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:15:21.582602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-646e9fb0-cb29-4b5d-89cb-742f08eecc60 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.881097 Aug 29 20:15:21.588511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 126/252] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:15:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:15:21.599114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8c9acce1-ed66-47a8-806e-0e432314a96d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:21.600074 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8c9acce1-ed66-47a8-806e-0e432314a96d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:21.750098 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8c9acce1-ed66-47a8-806e-0e432314a96d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:21.771894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8c9acce1-ed66-47a8-806e-0e432314a96d tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1218 microversion: 2.1 time: 0.176244 Aug 29 20:15:21.773664 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 127/253] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:21 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:21.844820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:21.855483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae00c6fb-b7bb-4db4-8def-cedac4056596 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.491438 Aug 29 20:15:21.873524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 127/254] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:21 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:22.799828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:22.800504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:22.813762 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:22.816585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:22.817063 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:22.819034 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:22.820283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:22.821319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:22.886675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:22.888104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:22.927491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:22.928366 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:22.929486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:22.930598 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:22.931291 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:22.932456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:22.949678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:22.974617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ffce86a3-b16e-49a8-8b79-bb9e5839b3eb tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1270 microversion: 2.1 time: 0.175440 Aug 29 20:15:22.981927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 128/255] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:22 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:23.472839 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:23.485961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f52416f-83c7-4af6-9634-d3aedb458326 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.609550 Aug 29 20:15:23.486771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 128/256] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:22 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:24.008118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:24.009360 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:24.030994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.039859 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.048473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.056150 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.056901 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.062567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.212475 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:24.222676 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-56a7ff9e-cabc-47a1-9787-0514759654dd tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1278 microversion: 2.1 time: 0.219682 Aug 29 20:15:24.223299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 129/257] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:24 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:24.506707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:24.508169 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:24.522486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.524306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.528680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.529537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:24.530023 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:24.532534 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:24.973623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:25.003247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e1a6c5f-2c8d-4557-a680-c4c3817c0ec1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.491739 Aug 29 20:15:25.016780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 129/258] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:24 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:25.244569 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:25.245792 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:25.254936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:25.257688 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:25.260090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:25.263534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:25.264349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:25.267893 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:25.471855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:25.484239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0f457f79-745d-4832-804e-ae7ea1ffef1e tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1276 microversion: 2.1 time: 0.244080 Aug 29 20:15:25.501488 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 130/259] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:25 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1276 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:26.026550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:26.027256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:26.040868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:26.045055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:26.046242 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:26.048721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:26.049246 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:26.053115 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:26.394768 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:26.403193 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2860faa1-2af0-4704-8208-2c236eba2798 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1525 microversion: 2.1 time: 0.381825 Aug 29 20:15:26.422461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 130/260] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:26 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1525 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:26.511669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:26.512278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:26.524451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:26.530040 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:26.530611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:26.531388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:26.531830 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:26.532253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:26.763276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:26.770744 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3cbcdb57-6dd7-4f89-8d31-ebe7d3cf6ee3 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.263231 Aug 29 20:15:26.783450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 131/261] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:26 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:27.301894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d6d84a38-2ce1-4f62-82c1-e49487652aa6 req-02019991-20c6-46f7-95e0-e2d9663b4bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfc523d-0654-4655-b188-ad49ecf7cf26", "tag": "31e08847-185b-420a-b5d3-78654bbfed85"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:27.325988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6d84a38-2ce1-4f62-82c1-e49487652aa6 req-02019991-20c6-46f7-95e0-e2d9663b4bc0 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.325988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6d84a38-2ce1-4f62-82c1-e49487652aa6 req-02019991-20c6-46f7-95e0-e2d9663b4bc0 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.325988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6d84a38-2ce1-4f62-82c1-e49487652aa6 req-02019991-20c6-46f7-95e0-e2d9663b4bc0 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.340166 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d6d84a38-2ce1-4f62-82c1-e49487652aa6 req-02019991-20c6-46f7-95e0-e2d9663b4bc0 service nova] Creating event network-changed:31e08847-185b-420a-b5d3-78654bbfed85 for instance ecfc523d-0654-4655-b188-ad49ecf7cf26 on hv-cinder-85426 Aug 29 20:15:27.345583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d6d84a38-2ce1-4f62-82c1-e49487652aa6 req-02019991-20c6-46f7-95e0-e2d9663b4bc0 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047742 Aug 29 20:15:27.346793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 131/262] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:27.429361 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:27.430871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:27.441311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.442462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.443130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.444036 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.446331 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.446951 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.621372 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:27.644479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ac43be44-9af5-4e50-8f5a-7ad2540948bf tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1505 microversion: 2.1 time: 0.219223 Aug 29 20:15:27.645074 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 132/263] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:27 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:27.665920 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:27.666624 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:27.686774 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.687302 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.687739 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.688451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.688910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.689338 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.792893 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:27.793856 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:27.809900 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.810979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.811696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:27.812418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:27.812875 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:27.813300 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:28.142653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:28.158524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bc805e8-fac2-4a06-9431-6a8312975732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1519 microversion: 2.1 time: 0.497851 Aug 29 20:15:28.159137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 132/264] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:27 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1519 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:28.283726 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:28.293835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3fc06471-b7e1-49a2-9939-4623e7b498d0 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.506343 Aug 29 20:15:28.298658 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 133/265] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:27 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:29.319748 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:29.320684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:29.333461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:29.336164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:29.336716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:29.337480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:29.338032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:29.338468 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:29.528733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:29.542417 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fcf9c562-7ead-4253-9be1-035489cefdc5 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.227388 Aug 29 20:15:29.543532 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 133/266] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:29 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:29.864104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:29.873021 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:29.901303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:29.901999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:29.903601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:29.905537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:29.907869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:29.909064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:29.993089 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'flavor' on Instance uuid 95ad0c45-261e-4857-a9bb-30cdd91fc949 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:30.261082 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ba81def9-8c5d-42c0-97df-30a483d3d7bc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Action: 'create', calling method: .version_select at 0x7f446959ae50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-493868041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKCNPyDBCXj8f3L4u752IDNb8RvTQVK1eh+keuN8tCsz/at+qpmnjc95cvJxVZUQG+frd4e08xSqFM4PSAC6Ynxji5EbiHUFnOqtnWgVkpFhn8ITtvDJOnkoi+ZXpcE+g=="}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:30.273754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75f95872-5dc3-45dc-a27c-9a59a13295ca tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949/action" status: 200 len: 32 microversion: 2.1 time: 0.423451 Aug 29 20:15:30.274974 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 134/267] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:15:29 2022] POST /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:15:30.293683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:30.293889 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-ba81def9-8c5d-42c0-97df-30a483d3d7bc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:30.294389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:30.299210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-ba81def9-8c5d-42c0-97df-30a483d3d7bc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for user a94af170fb414928970e7353964e31c0 and project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:30.308245 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.311065 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.314187 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:30.318350 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.323468 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.324237 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:30.330156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ba81def9-8c5d-42c0-97df-30a483d3d7bc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.503685 Aug 29 20:15:30.331058 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 134/268] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:15:29 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:30.537045 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:30.545747 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-679fe203-2144-437c-af98-511d0e6dc32c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.263077 Aug 29 20:15:30.546626 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 135/269] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:30 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:30.564733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:30.565439 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:30.572485 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.573275 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.575614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:30.576547 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:30.577154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:30.577676 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:30.790464 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:30.804889 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-be337716-2356-4762-a9d2-97581574b693 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.243815 Aug 29 20:15:30.805670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 135/270] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:30 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:31.572712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:31.573623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:31.580453 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:31.581191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:31.581815 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:31.582810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:31.583794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:31.584498 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:31.611374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:31.800372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:31.817548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f7a4d28-7a99-4fe1-beef-2db6193609d5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.249959 Aug 29 20:15:31.818135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 136/271] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:31 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:31.823237 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:31.830824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:31.831530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:31.841636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:31.842204 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:31.842651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:31.844642 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:31.849735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:31.851733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:32.161438 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:32.173804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-cc2a14cf-7a17-4023-874e-ba5f1cb8b9b7 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.349506 Aug 29 20:15:32.175759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 136/272] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:31 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:32.842724 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:32.843518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:32.858919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:32.859647 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:32.860197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:32.862113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:32.863331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:32.865490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:33.132814 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:33.142610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61f8ea4d-8d9e-4615-bbf2-5b293abc4732 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.304222 Aug 29 20:15:33.143682 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 137/273] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:32 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:33.197354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:33.198154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:33.204501 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:33.204981 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:33.205409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:33.206294 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:33.206848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:33.208674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:33.473395 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:33.482952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f0cf19ab-2206-4256-8203-e58fe3221dda tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.290369 Aug 29 20:15:33.483571 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 137/274] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:33 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:33.918680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-95e87044-1985-4d73-96bc-9018492384a4 req-b46913d7-e550-40b4-ae1f-f19a4f7fa359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc523d-0654-4655-b188-ad49ecf7cf26", "name": "network-vif-plugged", "status": "completed", "tag": "31e08847-185b-420a-b5d3-78654bbfed85"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:33.946563 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-95e87044-1985-4d73-96bc-9018492384a4 req-b46913d7-e550-40b4-ae1f-f19a4f7fa359 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:33.948059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-95e87044-1985-4d73-96bc-9018492384a4 req-b46913d7-e550-40b4-ae1f-f19a4f7fa359 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:33.948506 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-95e87044-1985-4d73-96bc-9018492384a4 req-b46913d7-e550-40b4-ae1f-f19a4f7fa359 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:33.971342 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-95e87044-1985-4d73-96bc-9018492384a4 req-b46913d7-e550-40b4-ae1f-f19a4f7fa359 service nova] Creating event network-vif-plugged:31e08847-185b-420a-b5d3-78654bbfed85 for instance ecfc523d-0654-4655-b188-ad49ecf7cf26 on hv-cinder-85426 Aug 29 20:15:33.994713 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-95e87044-1985-4d73-96bc-9018492384a4 req-b46913d7-e550-40b4-ae1f-f19a4f7fa359 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074049 Aug 29 20:15:33.996508 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 138/275] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:34.164684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:34.165282 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:34.180017 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.180518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.180952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.181658 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.182168 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.187818 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.405444 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:34.417859 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7db41794-64a3-468e-869c-035ae8870141 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.257183 Aug 29 20:15:34.418810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 138/276] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:34 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:34.508559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:34.509273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:34.519519 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.520359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.520940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.521881 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.522502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.523271 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.650124 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:34.650647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:34.659217 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.659841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.660271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.660977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:34.661426 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:34.662035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:34.693810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8c23b692-2437-4d23-ad51-cee801cba7d1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/ips" status: 200 len: 150 microversion: 2.1 time: 0.048244 Aug 29 20:15:34.695224 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 139/277] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:15:34 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:34.916084 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:34.951804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9fdb6f4-2a59-4ef0-96ae-b529ab88466f tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.448951 Aug 29 20:15:34.978347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 139/278] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:34 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:35.440209 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:35.441067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:35.447399 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.447885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.448314 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:35.449005 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.449517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.449869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:35.638727 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:35.646949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1ab1f75b-fecf-4d0f-b209-d2e5ba7bc74f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.209890 Aug 29 20:15:35.647577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 140/279] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:35 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:35.987730 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:35.989781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:35.997074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:35.997874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:35.998505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:35.999484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.000142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.000760 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.201001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cf47f67-3e6a-4396-97a7-fdc7f9921ce6"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:36.203461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:36.210220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.210713 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.211167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.211871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.212327 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.212752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.364843 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:36.374109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88dc977e-302d-4966-86d4-5617ccc445cc tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1318 microversion: 2.1 time: 0.392918 Aug 29 20:15:36.374817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 140/280] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:35 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:36.668945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:36.669552 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:36.677167 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.677710 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.678653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.679516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:36.679985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:36.680412 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:36.822319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:36.830078 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed92796c-4936-4420-9be7-2eefb79aa3eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.165498 Aug 29 20:15:36.831109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 141/281] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:36 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:37.033549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-dc228a04-5b77-4a9a-8e04-501d3d66cf15 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840506 Aug 29 20:15:37.040561 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 141/282] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:15:36 2022] POST /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:37.395661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:37.397564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:37.404871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:37.405433 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:37.405834 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:37.406499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:37.407054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:37.407392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:37.559590 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:37.568600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a441f2f-da44-4f63-9c21-dc8b474eccb2 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1501 microversion: 2.1 time: 0.176640 Aug 29 20:15:37.569179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 142/283] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:37 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:37.853647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:37.854486 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:37.873031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:37.873767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:37.874394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:37.875282 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:37.875834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:37.876351 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:37.901942 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:38.019424 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:38.028024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-789c2cc7-fb7f-4b43-a815-039e1a8f8e49 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.179686 Aug 29 20:15:38.028599 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 142/284] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:37 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:38.162293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:38.162864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:38.169635 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.170423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.171102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:38.171903 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.172537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.173048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:38.200533 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:15:38.299914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-291c93c2-1600-4fcb-b331-625095fb66c1 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "DELETE /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 204 len: 0 microversion: 2.1 time: 0.141007 Aug 29 20:15:38.301562 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 143/285] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:15:38 2022] DELETE /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:15:38.322199 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:38.323502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:38.334465 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.335043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.335551 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:38.336248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:38.336928 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:38.337796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:38.470336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:38.478751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a7698a4e-e205-4725-b9a4-b810a166ebc8 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1507 microversion: 2.1 time: 0.169827 Aug 29 20:15:38.479237 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 143/286] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:38 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:39.050345 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:39.051029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:39.058491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.058983 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.059461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.060202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.060665 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.061092 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.194531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:39.202207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38770e1e-c186-480c-9c85-9358fbb86799 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.156105 Aug 29 20:15:39.202761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 144/287] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:39 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:39.249177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:39.249847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:39.256529 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.257129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.257625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.258390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.258931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.259380 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.282552 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5693bd2b-a16d-49f8-bcb0-ecafc1403705 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/ips" status: 200 len: 151 microversion: 2.20 time: 0.037445 Aug 29 20:15:39.283176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 144/288] 10.222.0.121 () {60 vars in 1294 bytes} [Mon Aug 29 20:15:39 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:15:39.502245 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:39.502857 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:39.510612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.511259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.511792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.512634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:39.513190 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:39.513870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:39.690061 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:39.698629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69cc526f-4b7c-4e62-b747-50026a40625a tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1507 microversion: 2.1 time: 0.201942 Aug 29 20:15:39.699279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 145/289] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:39 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:40.223940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:40.225138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:40.230990 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.231508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.231937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.232617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.233069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.233483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.311759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=12 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:40.367607 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:40.375437 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-49691f45-e914-46cf-936e-d8396e619057 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.155409 Aug 29 20:15:40.376003 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 145/290] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:40 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:40.722749 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:40.724118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:40.748376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.748870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.749299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.750007 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.750459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.750886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.785466 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-37a61aa2-8fae-4a26-9358-3a990a0785d9 req-21735924-f9b4-4be9-ac5d-3a06417598a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc523d-0654-4655-b188-ad49ecf7cf26", "name": "network-vif-deleted", "tag": "31e08847-185b-420a-b5d3-78654bbfed85"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:40.796428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-37a61aa2-8fae-4a26-9358-3a990a0785d9 req-21735924-f9b4-4be9-ac5d-3a06417598a1 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:40.797145 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-37a61aa2-8fae-4a26-9358-3a990a0785d9 req-21735924-f9b4-4be9-ac5d-3a06417598a1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:40.798139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-37a61aa2-8fae-4a26-9358-3a990a0785d9 req-21735924-f9b4-4be9-ac5d-3a06417598a1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:40.815742 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-37a61aa2-8fae-4a26-9358-3a990a0785d9 req-21735924-f9b4-4be9-ac5d-3a06417598a1 service nova] Creating event network-vif-deleted:31e08847-185b-420a-b5d3-78654bbfed85 for instance ecfc523d-0654-4655-b188-ad49ecf7cf26 on hv-cinder-85426 Aug 29 20:15:40.822804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-37a61aa2-8fae-4a26-9358-3a990a0785d9 req-21735924-f9b4-4be9-ac5d-3a06417598a1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041006 Aug 29 20:15:40.823741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 146/291] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:40.867977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3b898f6267460896913b7c31bfca40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3135b1db5b604d55ad55622977cbae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:40.875845 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-39174f72-84b2-4619-a6db-fa98c4f5a90c tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 200 len: 1465 microversion: 2.1 time: 0.158849 Aug 29 20:15:40.876360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 146/292] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:40 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:41.398143 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:41.398904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:41.401108 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:41.406549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:41.407046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:41.407657 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:41.408369 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:41.408826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:41.409522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:41.582418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:41.592123 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-85889918-ac32-4d73-909a-569d3f2855a5 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.198791 Aug 29 20:15:41.592700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 147/293] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:41 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:41.898586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:41.899257 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] [instance: ecfc523d-0654-4655-b188-ad49ecf7cf26] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:41.901721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:41.916379 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:41.917121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:41.917505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:41.918282 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:41.918746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:41.919192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:41.938166 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] HTTP exception thrown: Instance ecfc523d-0654-4655-b188-ad49ecf7cf26 could not be found. Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Request method failure captured: Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 HTTP/1.1 Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR47NozcKsQedX2mOenc7muGhRqvIpnOY2Z9FRg5YPkBqVy9oEF_7CJwGvc5GdoYx7YMQN6fw5XgSXgdHWJfer3uMtcjFvHTJQat6-qXxXC63OY_0u45t384yCq6VE0FjJHJBqVF_NV67qIdzzgJLXXfNEqZvD8PR55wLdl8RKxY-kM Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 3135b1db5b604d55ad55622977cbae5d Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesActionsTest-471433881 Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:15:41.939861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3135b1db5b604d55ad55622977cbae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3135b1db5b604d55ad55622977cbae5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3135b1db5b604d55ad55622977cbae5d", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3135b1db5b604d55ad55622977cbae5d"}]}] Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesActionsTest-471433881 Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 3135b1db5b604d55ad55622977cbae5d Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesActionsTest-471433881 Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesActionsTest-471433881-project Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 5c3b898f6267460896913b7c31bfca40 Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesActionsTest-471433881-project Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance ecfc523d-0654-4655-b188-ad49ecf7cf26 could not be found. Aug 29 20:15:41.941223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'ecfc523d-0654-4655-b188-ad49ecf7cf26'} Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecfc523d-0654-4655-b188-ad49ecf7cf26 could not be found. Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:41.941941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecfc523d-0654-4655-b188-ad49ecf7cf26 could not be found. Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecfc523d-0654-4655-b188-ad49ecf7cf26 could not be found. Aug 29 20:15:41.943704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:15:41.945769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] Returning 404 to user: Instance ecfc523d-0654-4655-b188-ad49ecf7cf26 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:41.945769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8e5ec26-7e09-41b4-a10b-730244f63262 tempest-VolumesActionsTest-471433881 tempest-VolumesActionsTest-471433881-project] 10.222.0.121 "GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26" status: 404 len: 111 microversion: 2.1 time: 0.047282 Aug 29 20:15:41.945769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 147/294] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:41 2022] GET /compute/v2.1/servers/ecfc523d-0654-4655-b188-ad49ecf7cf26 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:15:42.098129 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:42.098736 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:42.106142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.106829 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.107308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.107971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.108644 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.109138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.139440 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lazy-loading 'flavor' on Instance uuid 2ee34ea9-ae27-4156-8f42-17d06286bebe {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:15:42.371249 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-15c4a7d0-1ddd-4ddc-bd17-76b4c6b0f3a6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/action" status: 202 len: 0 microversion: 2.20 time: 0.280219 Aug 29 20:15:42.375213 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 148/295] 10.222.0.121 () {62 vars in 1324 bytes} [Mon Aug 29 20:15:42 2022] POST /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:15:42.381099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:42.381762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:42.388128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.389455 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.390301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.390899 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.393604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.593814 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:42.604477 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:42.606358 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:42.608782 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1800bd62-d023-4fff-afae-4742afd179e3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.231951 Aug 29 20:15:42.609636 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 148/296] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:42 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:42.618669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:42.619451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:42.626778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.627340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.627789 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.628480 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:42.628938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:42.629359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:42.795043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:42.814385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-72d82943-db92-4ffa-8755-79388874cafe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.191416 Aug 29 20:15:42.814385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 149/297] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:42 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:43.632696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:43.633297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:43.640833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.641814 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.642231 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.643175 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.643740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.644134 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.792788 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:43.801546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:43.803520 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:43.804737 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b531b448-032a-45ab-bf0f-3f2cf1c5d528 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.176440 Aug 29 20:15:43.805301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 149/298] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:43 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:43.825257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:43.825722 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:43.832512 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.833698 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.834396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.835342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:43.835984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:43.836590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:43.986665 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:43.995776 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6eda8844-7ed5-4e77-adb7-4a760679da99 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.174794 Aug 29 20:15:43.996345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 150/299] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:43 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:44.829043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:44.829986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:44.837320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:44.837804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:44.838230 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:44.838933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:44.839457 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:44.839877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:45.017278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:45.017812 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:45.025538 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:45.026033 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:45.026466 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:45.027200 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:45.027662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:45.028084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:45.057478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:45.066516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:45.068709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:45.069870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0823f17e-e2f9-409d-925c-1fae5dd93011 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.244730 Aug 29 20:15:45.070423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 150/300] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:44 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:45.181778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:45.189538 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e95b1382-309d-4d65-ba5a-4406d4788015 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.176159 Aug 29 20:15:45.200631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 151/301] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:45 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:46.094334 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:46.094978 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:46.101717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:46.102283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:46.102787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:46.103598 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:46.104128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:46.104649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:46.210555 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:46.211780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:46.218453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:46.219258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:46.219893 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:46.220995 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:46.221530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:46.222268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:46.242766 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:46.251527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:46.252968 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:46.254275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c6cb05b-349d-4c43-9844-d518feaaaaa5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.163899 Aug 29 20:15:46.257310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 151/302] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:46 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:46.413780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:46.421923 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0357e999-3f6b-441b-8b65-fd056b19e804 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.215079 Aug 29 20:15:46.422518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 152/303] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:46 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:47.282223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:47.282850 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:47.289599 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:47.290083 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:47.290526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:47.291243 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:47.291863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:47.292286 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:47.426482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:47.430753 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:47.436665 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:47.438188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:47.439499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a4ffe9d-59b4-417a-93d1-9e5a1dcbfa28 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.161290 Aug 29 20:15:47.440234 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 152/304] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:47 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:47.443646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:47.444310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:47.450714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:47.451227 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:47.451657 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:47.452344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:47.452791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:47.453388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:47.591787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:47.599707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-57fb18fc-ebd3-4eb8-a96f-72951a66c445 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.160302 Aug 29 20:15:47.600501 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 153/305] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:47 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:47.870560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d0138e68-7995-4eba-b52a-1e1321eae0d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: .version_select at 0x7f44696f6a60>, body: {"keypair": {"name": "tempest-keypair-1743204863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqsThijAN9+vIJEku0nF4xj2ca1D6YyItYA5E+B3LjZ01jRySedtQ7EYt11CWH1caVcBBH0tjWjxgGfUbBPvx6Ju52pqaoZK8h6OlZHY9oy0UdafaqFCh2UNPFRtoVqzQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:47.894436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d0138e68-7995-4eba-b52a-1e1321eae0d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:47.898486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d0138e68-7995-4eba-b52a-1e1321eae0d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:47.924472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d0138e68-7995-4eba-b52a-1e1321eae0d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060125 Aug 29 20:15:47.925684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 153/306] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:15:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:48.464380 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:48.465335 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:48.474699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:48.475784 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:48.476739 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:48.477989 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:48.479808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:48.480368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:48.620527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:48.621268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:48.629218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:48.630246 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:48.634249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:48.635033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:48.637555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:48.638672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:48.870092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:48.880636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:48.892394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:48.893683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1efd78d5-5d90-4230-a29c-10503bcd93dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.433641 Aug 29 20:15:48.894245 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 154/307] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:48 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:48.967560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:48.983338 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-242c563f-0e29-4a67-ad65-fc15ba1395ba tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.364164 Aug 29 20:15:48.984125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 154/308] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:48 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:49.920040 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:49.920722 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:49.933828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:49.934309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:49.934957 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:49.936500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:49.940371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:49.940810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:50.012074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:50.016176 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:50.028115 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:50.032062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:50.032750 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:50.034162 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:50.050946 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:50.051527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:50.274766 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:50.287477 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:50.289641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:50.296178 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-885ac44b-6bcf-43b5-b1b5-3a6add23ef69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.381661 Aug 29 20:15:50.297239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 155/309] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:49 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:15:50.298295 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:50.303667 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1024389998", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "190f63a4-9b8c-4268-a1f5-7e230ea6f86c"}], "security_groups": [{"name": "tempest-securitygroup--426342392"}], "key_name": "tempest-keypair-1743204863", "user_data": "}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:50.320428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af827a4f-f07a-4949-ab07-2ad0e2c4cdaa tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.310446 Aug 29 20:15:50.331125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 155/310] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:50 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:50.475918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] validate_networks() for [('190f63a4-9b8c-4268-a1f5-7e230ea6f86c', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:15:51.028622 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:15:51.029234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:15:51.029489 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:15:51.030062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:15:51.030640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:15:51.189175 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.190097 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.190775 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.191732 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.192959 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.193455 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.212071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:51.216187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:51.227636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:15:51.229936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:15:51.279826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b2be54e8-43e2-4d91-9477-a2cd27117729 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.981379 Aug 29 20:15:51.280473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 156/311] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:15:50 2022] POST /compute/v2.1/servers => generated 403 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:15:51.295687 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-357a0f77-11b3-4d5c-b65c-3f91b7face6a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:51.296995 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-357a0f77-11b3-4d5c-b65c-3f91b7face6a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:51.325448 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:51.326120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:51.333107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.334104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.334548 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.337235 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.338059 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.338663 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.399566 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-357a0f77-11b3-4d5c-b65c-3f91b7face6a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:51.406679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-357a0f77-11b3-4d5c-b65c-3f91b7face6a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1246 microversion: 2.1 time: 0.118382 Aug 29 20:15:51.408817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 156/312] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:51 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:51.414595 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:51.423310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:51.433353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.433924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.434421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.435226 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.435929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.436455 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.607206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:51.619456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:51.622239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:51.623780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-335bf176-1eb8-4726-b1f5-47ae833124f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.302560 Aug 29 20:15:51.639120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 157/313] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:51 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:15:51.669869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:51.682802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c22e64cc-17a9-4d50-a95f-84252f113058 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1505 microversion: 2.1 time: 0.272263 Aug 29 20:15:51.683917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 157/314] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:51 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:51.711863 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3343a028-907d-4923-8e58-2d9ac0512e4a"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:51.714473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:51.730407 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.730999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.731896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.732804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.733944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.734836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.768799 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] HTTP exception thrown: Cannot 'attach_volume' instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 while it is in vm_state rescued Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Request method failure captured: Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: POST /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949/os-volume_attachments HTTP/1.1 Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 74 Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3-Cs8s_ULLOsdfgfc5xj3VhVd6z9RFUxXBqIwc9ZHVvI7-RhGZMkEFM-bcV4zf9lWw5NFP1E_1eH7sNNtouuLUBpyU6Qe8qwt_QE8WcJ6oe_ICBeRcRy_CUHp4qTV4NWCaMW7GAD_FqOnxLPhxSUFc7L9Vobg8cMSwBwbBL1mmGSY Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:15:51.771429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_eaabbc4be9754bcda6adc796a0340c49", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}] Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 58bf9cf55cfc45d3841366f601abe4f8 Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {"volumeAttachment": {"volumeId": "3343a028-907d-4923-8e58-2d9ac0512e4a"}} Aug 29 20:15:51.773252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Cannot 'attach_volume' instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 while it is in vm_state rescued Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'server_id': '95ad0c45-261e-4857-a9bb-30cdd91fc949', 'body': {'volumeAttachment': {'volumeId': '3343a028-907d-4923-8e58-2d9ac0512e4a'}}} Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:15:51.774187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 while it is in vm_state rescued Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:15:51.775507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:15:51.777974 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:15:51.777974 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:15:51.777974 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 while it is in vm_state rescued Aug 29 20:15:51.777974 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:15:51.779620 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Returning 409 to user: Cannot 'attach_volume' instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 while it is in vm_state rescued {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:15:51.781286 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f246296c-7c3a-4b12-b0e6-f9b5722e2050 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.075852 Aug 29 20:15:51.782285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 158/315] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:15:51 2022] POST /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949/os-volume_attachments => generated 152 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:15:51.795302 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:51.795839 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:51.803551 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.804597 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.805318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.806314 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.806779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.807451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.883556 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb226461-6b13-4e5b-bbb8-b9df1616a615 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949/action" status: 202 len: 0 microversion: 2.1 time: 0.093470 Aug 29 20:15:51.884936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 158/316] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:15:51 2022] POST /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:15:51.894147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:51.895111 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:51.915613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.917654 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.917654 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.919201 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:51.923367 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:51.924268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:51.932626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:52.089034 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:52.098942 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a24c8b4e-39f8-4576-843b-36ddc4030b94 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1513 microversion: 2.1 time: 0.208916 Aug 29 20:15:52.099633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 159/317] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:51 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:52.432243 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:52.433086 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:52.450293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:52.450958 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:52.451524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:52.452136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:52.452597 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:52.453028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:52.555162 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:52.563521 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef68c0c4-b26e-4538-97b5-3308869f1df4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1298 microversion: 2.1 time: 0.137866 Aug 29 20:15:52.564116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 159/318] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:52 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:52.649135 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:52.649739 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:52.656555 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:52.657026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:52.657472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:52.658149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:52.658600 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:52.659059 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:52.804341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:52.812510 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:52.813956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:52.815151 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ba013839-0b4b-42ec-90cd-67d0ed7baec8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.170444 Aug 29 20:15:52.815886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 160/319] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:52 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:53.123576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:53.124280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:53.133226 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:53.133807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:53.134398 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:53.136146 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:53.137792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:53.139062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:53.304019 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:53.313781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-132209c9-ddb1-4f7c-a289-8d86e042a5eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1513 microversion: 2.1 time: 0.195964 Aug 29 20:15:53.314359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 160/320] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:53 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:53.588064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:53.589410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:53.598095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:53.599823 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:53.600752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:53.601926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:53.602781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:53.603759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:53.700903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:53.718757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a05bca05-916e-401d-91e5-2e1f8927dde4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1304 microversion: 2.1 time: 0.136923 Aug 29 20:15:53.719838 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 161/321] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:53 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:53.725376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-535580611", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-493868041", "security_groups": [{"name": "tempest-secgroup-smoke-645306244"}], "block_device_mapping_v2": [{"uuid": "89248417-33c4-4fec-9b0e-8bb98dc1776e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93b3736e-f236-4f4c-bc10-39fdec95bd29"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:53.839529 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:53.840514 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:53.852066 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:53.853081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:53.854215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:53.856283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:53.857398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:53.859790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:53.880702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] validate_networks() for [('93b3736e-f236-4f4c-bc10-39fdec95bd29', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:15:54.320789 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:54.339278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:54.341057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:54.343513 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c662200c-90da-4dee-be04-4d4a60530a69 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.508704 Aug 29 20:15:54.343513 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 162/322] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:53 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:54.360248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:54.360855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:54.367243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:54.367741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:54.368201 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:54.368903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:54.369362 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:54.369823 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:54.622054 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:54.632993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0a39d30a-6c2c-49b1-ac29-864dbdef6bfe tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1513 microversion: 2.1 time: 0.276460 Aug 29 20:15:54.633853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 163/323] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:54 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:54.671849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:15:54.672266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:15:54.672801 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:15:54.673130 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:15:54.673538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:15:54.684030 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:54.684658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:54.685168 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:54.686015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:54.686568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:54.687176 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:54.708932 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:54.713685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for user a94af170fb414928970e7353964e31c0 and project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:54.745816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:54.747644 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:54.757306 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:54.758328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:54.758946 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:54.759967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:54.760809 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:54.761343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:54.795723 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:15:54.797983 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89248417-33c4-4fec-9b0e-8bb98dc1776e',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:15:54.884751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:54.902324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4fd75c32-25f5-40e3-8541-89f9213976d6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1304 microversion: 2.1 time: 0.160689 Aug 29 20:15:54.904847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 164/324] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:54 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:55.050637 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7f2aeab-a4e8-498e-a6db-f7db45ba34c5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.330081 Aug 29 20:15:55.052443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 161/325] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:15:53 2022] POST /compute/v2.1/servers => generated 407 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:15:55.064153 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3692a158-9696-40aa-840d-1888b2df3f78 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:55.065687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3692a158-9696-40aa-840d-1888b2df3f78 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:55.153579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3692a158-9696-40aa-840d-1888b2df3f78 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:55.167002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3692a158-9696-40aa-840d-1888b2df3f78 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1096 microversion: 2.1 time: 0.107494 Aug 29 20:15:55.168440 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 165/326] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:55 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1096 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:55.371378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:55.372367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:55.380715 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:55.381382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:55.381876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:55.382584 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:55.383036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:55.383487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:55.624389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:55.637323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:55.638804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:55.640246 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-724cc6e3-ac11-49b6-8697-f56b96bc47c3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.274119 Aug 29 20:15:55.640813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 162/327] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:55 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:15:55.660625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:55.661635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:55.683950 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:55.685945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:55.686402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:55.689598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:55.690088 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:55.691950 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:55.926347 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:55.935681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:55.936839 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-577613a5-3be5-4bfc-94b9-72cf68ef5545 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1519 microversion: 2.1 time: 0.281725 Aug 29 20:15:55.937445 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:55.937961 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 166/328] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:55 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:55.962425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:55.965256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:55.965883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:55.970131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:55.974659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:55.977077 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:56.192096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:56.193156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:56.210572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:56.211343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:56.211776 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:56.215622 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:56.216347 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:56.216966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:56.279240 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:56.292692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6588bbeb-d3ae-4ffd-aa3d-ba9efd6ec486 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.365921 Aug 29 20:15:56.293732 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 163/329] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:55 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:56.331066 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:56.339956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-92409c8e-0b57-40e6-91f6-77a123c98e63 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1194 microversion: 2.1 time: 0.154032 Aug 29 20:15:56.341106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 167/330] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:56 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:15:56.666401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:56.667479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:56.674023 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:56.675094 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:56.675527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:56.676759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:56.677215 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:56.677633 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:56.741419 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-5579a345-0e57-4c02-9019-b92eb757cd36 req-83f05f18-b256-4925-a189-ca7306b621a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce8543-4378-4a6f-b1ce-c98e6321ec59", "tag": "1db8c83e-b525-40c2-96a4-682d0468352c"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:56.758617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-5579a345-0e57-4c02-9019-b92eb757cd36 req-83f05f18-b256-4925-a189-ca7306b621a4 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:56.759046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-5579a345-0e57-4c02-9019-b92eb757cd36 req-83f05f18-b256-4925-a189-ca7306b621a4 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:56.768323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-5579a345-0e57-4c02-9019-b92eb757cd36 req-83f05f18-b256-4925-a189-ca7306b621a4 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:56.783061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-5579a345-0e57-4c02-9019-b92eb757cd36 req-83f05f18-b256-4925-a189-ca7306b621a4 service nova] Creating event network-changed:1db8c83e-b525-40c2-96a4-682d0468352c for instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 on hv-cinder-85426 Aug 29 20:15:56.788861 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-5579a345-0e57-4c02-9019-b92eb757cd36 req-83f05f18-b256-4925-a189-ca7306b621a4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051872 Aug 29 20:15:56.790134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 168/331] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:15:56.862136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:56.877348 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:56.879134 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:56.880292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c3b6d6d-a976-4aec-a330-9cc60fcf9eaf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.218098 Aug 29 20:15:56.881070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 164/332] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:56 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:57.314886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:57.316104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:57.323392 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:57.324054 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:57.324587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:57.325374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:57.325906 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:57.326398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:57.366640 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:57.367379 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:57.377516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:57.378026 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:57.384753 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:57.385786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:57.386267 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:57.386714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:57.489576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:57.502926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f65007d9-ed16-45f5-a3fc-060c85c565b8 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1212 microversion: 2.1 time: 0.140276 Aug 29 20:15:57.507445 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 165/333] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:57 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:57.519158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:57.529134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-815e1b87-a626-441d-85a9-02b6f0d425dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.218626 Aug 29 20:15:57.534886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 169/334] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:57 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:57.581972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f7fa494-0fef-4352-872a-7974c0b59518 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'create', calling method: .version_select at 0x7f44695f5e50>, body: {"keypair": {"name": "tempest-keypair-1207543991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEzHnPruj8xcwmigtBL73QIC0TXi1BABB+eZynwK3HKabA/GvaxAX7+J3LOibB/EjKbsO0RBsDQ1TxfX73SidrePeAifIABzu77heQc1OteiFnd6qaCkJ8AOakiG3y5GQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:15:57.601172 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-3f7fa494-0fef-4352-872a-7974c0b59518 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for project eaabbc4be9754bcda6adc796a0340c49. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:15:57.607239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-3f7fa494-0fef-4352-872a-7974c0b59518 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for user 58bf9cf55cfc45d3841366f601abe4f8 and project eaabbc4be9754bcda6adc796a0340c49. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:15:57.635087 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f7fa494-0fef-4352-872a-7974c0b59518 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057002 Aug 29 20:15:57.636001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 166/335] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:15:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:15:57.906418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:57.907688 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:57.930604 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:57.932742 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:57.936225 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:57.949045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:57.950014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:57.954790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:58.255249 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:58.265767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:58.269949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:58.273645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7179041e-612e-4bcd-9a0b-accdb80bf29d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.372589 Aug 29 20:15:58.276116 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 170/336] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:57 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:58.530222 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:58.531414 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:58.540502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:58.541320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:58.541855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:58.543214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:58.544173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:58.544608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:58.552624 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:58.554536 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:58.565563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:58.567590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:58.576295 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:58.577744 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:58.580847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:58.583590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:58.681345 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:58.693399 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2a64f87-f705-4b26-a578-32ada27a91f1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1200 microversion: 2.1 time: 0.167594 Aug 29 20:15:58.697573 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 167/337] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:58 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1200 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:58.836467 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:58.854574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-882f227b-d068-44d2-956a-46d9f5466b8b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.305819 Aug 29 20:15:58.855907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 171/338] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:58 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:15:59.302873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:59.306346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:59.313815 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:59.314744 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:59.315411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:59.316896 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:59.317517 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:59.318152 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:59.547543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:59.557949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:59.559905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:15:59.561297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-502f87e8-310c-409f-83ba-9566268f6839 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.265815 Aug 29 20:15:59.562485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 168/339] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:15:59 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:15:59.723354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:59.724223 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:59.730888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:59.733839 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:59.734644 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:59.735792 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:59.736530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:59.737197 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:59.876244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:15:59.877558 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:15:59.900001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:59.901173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:59.901913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:59.902936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:15:59.903824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:15:59.904547 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:15:59.991058 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:00.004921 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9b57ef5c-c34a-4e1e-b20e-acf63cae4c0c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.286558 Aug 29 20:16:00.006407 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 172/340] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:59 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:00.116939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:00.139988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df88df24-f2f5-4995-8578-896143f05d81 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.267764 Aug 29 20:16:00.141424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 169/341] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:15:59 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:00.585415 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:00.586014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:00.592131 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:00.592603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:00.593322 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:00.594218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:00.594791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:00.595235 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:00.746766 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:00.755770 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:00.757522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:00.759045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4b301130-ba4a-4f28-a842-28ec4244912c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.177880 Aug 29 20:16:00.760344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 173/342] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:00 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:00.866488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-704ed4ea-94f2-475a-bf22-54ed5dd28dde req-d96c9c87-5b52-446d-ada4-ca72a447a367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af99cf2b-b549-400f-bad3-1bf633c6a2c4", "tag": "560f6043-4fba-46ff-bc9d-77f769ad7a55"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:00.898560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-704ed4ea-94f2-475a-bf22-54ed5dd28dde req-d96c9c87-5b52-446d-ada4-ca72a447a367 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:00.904871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-704ed4ea-94f2-475a-bf22-54ed5dd28dde req-d96c9c87-5b52-446d-ada4-ca72a447a367 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:00.907516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-704ed4ea-94f2-475a-bf22-54ed5dd28dde req-d96c9c87-5b52-446d-ada4-ca72a447a367 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:00.932155 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-704ed4ea-94f2-475a-bf22-54ed5dd28dde req-d96c9c87-5b52-446d-ada4-ca72a447a367 service nova] Creating event network-changed:560f6043-4fba-46ff-bc9d-77f769ad7a55 for instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 on hv-cinder-85426 Aug 29 20:16:00.938088 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-704ed4ea-94f2-475a-bf22-54ed5dd28dde req-d96c9c87-5b52-446d-ada4-ca72a447a367 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075410 Aug 29 20:16:00.938761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 170/343] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:01.018590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2002057455", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d90d67e-b915-4e8e-aedc-6d41260ae197"}], "security_groups": [{"name": "tempest-securitygroup--2903028"}], "key_name": "tempest-keypair-1207543991", "user_data": "}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:01.028833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:01.029663 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:01.047992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:01.048490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:01.048922 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:01.049818 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:01.050476 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:01.050903 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:01.201972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:01.205399 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:01.216078 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-511f6428-9e9d-4043-8d74-541cb8acba7c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.191696 Aug 29 20:16:01.224684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 171/344] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:01 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:01.230933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:01.231848 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:01.239058 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:01.240440 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:01.241081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:01.242017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:01.242694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:01.243318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:01.398160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:01.402263 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:01.407927 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96fe1c7d-4faf-44c8-be56-5229bb359cf5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.181821 Aug 29 20:16:01.422243 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 172/345] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:01 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:01.781974 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:01.782528 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:01.790567 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:01.791106 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:01.791544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:01.792248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:01.792711 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:01.793134 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:02.010850 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:02.020672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:02.025732 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:02.027852 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64f9f901-8507-4c81-b59b-a9df5879bcd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.249974 Aug 29 20:16:02.028840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 173/346] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:01 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:02.237291 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:02.238509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:02.246108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:02.246897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:02.247585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:02.248441 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:02.249048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:02.249645 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:02.406230 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:02.415361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25bea4e2-c2b6-48ac-b9a6-f3c6dde85768 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.182429 Aug 29 20:16:02.416019 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 174/347] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:02 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:02.432443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:02.433143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:02.440886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:02.441482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:02.447856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:02.448865 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:02.449515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:02.450017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:02.602440 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:02.602440 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02e91ff3-d39f-49cc-addb-4b9210c9e69d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.176689 Aug 29 20:16:02.614085 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 175/348] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:02 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:03.056337 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:03.057025 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:03.064627 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:03.065174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:03.065629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:03.066936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:03.068207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:03.068207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:03.233692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:03.243865 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:03.245371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:03.246641 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3477846a-5c1d-4d36-9e06-180891c424c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.195298 Aug 29 20:16:03.247551 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 176/349] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:03 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:03.438357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:03.438905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:03.445390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:03.445866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:03.446301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:03.446999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:03.447485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:03.447905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:03.588289 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:03.596616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbd01515-a7ad-494e-ba54-2ce5904f615d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.162880 Aug 29 20:16:03.597238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 177/350] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:03 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:03.624762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:03.624762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:03.624762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:03.631019 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:03.631535 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:03.631968 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:03.632670 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:03.633465 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:03.633899 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:03.777993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:03.786355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aee006c8-ae45-4961-98e1-f9d406a22641 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.168385 Aug 29 20:16:03.791118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 178/351] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:03 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:04.270038 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:04.270726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:04.284963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:04.285699 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:04.287092 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:04.287941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:04.288957 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:04.289474 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:04.458707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:04.467719 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:04.469212 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:04.470410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5a3dfc2-df37-4874-bc40-a5893b7499e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1748 microversion: 2.20 time: 0.204571 Aug 29 20:16:04.470997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 179/352] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:04 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1748 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:04.618342 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:04.618970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:04.625086 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:04.625558 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:04.625985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:04.626682 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:04.627159 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:04.627576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:04.697781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:04.796672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:04.806455 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1151d814-636e-4432-a2f5-3e01b8f74215 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.192405 Aug 29 20:16:04.820891 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 180/353] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:04 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:04.825939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:04.826681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:04.833677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:04.834283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:04.834823 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:04.835662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:04.836248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:04.836785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:05.006039 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:05.014145 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-348c45f2-494b-4cae-a59c-bf3524ed1f02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.192222 Aug 29 20:16:05.014712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 181/354] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:04 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:05.159810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=8 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:05.494481 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:05.495153 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:05.501757 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:05.502260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:05.502703 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:05.503437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:05.503911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:05.505141 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:05.644362 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:05.655921 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:05.657488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:05.658712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd074322-4e2c-4824-a47c-baa5cb668959 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1748 microversion: 2.20 time: 0.168205 Aug 29 20:16:05.659371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 182/355] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:05 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:05.828284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:05.829065 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:05.837013 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:05.837531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:05.837970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:05.838692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:05.839269 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:05.839720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:05.985125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:05.993305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71bea84e-57e6-482c-aa10-acf70f80c691 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.168966 Aug 29 20:16:05.993973 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 183/356] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:05 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:06.035581 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:06.036100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:06.042209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:06.042879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:06.043314 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:06.044004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:06.044609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:06.045195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:06.189772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:06.199573 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1efeaf20-15af-447c-9096-3ad1e0518828 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.168298 Aug 29 20:16:06.200379 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 184/357] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:06 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:06.683376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:06.684018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:06.691217 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:06.692303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:06.692744 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:06.693489 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:06.693958 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:06.694388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:06.868899 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:06.876855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:06.878969 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:06.880694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92348e90-4840-4002-9f00-ba4bb9105ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.201436 Aug 29 20:16:06.887675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 185/358] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:06 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:07.013761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:07.014383 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:07.021046 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:07.021536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:07.021972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:07.022654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:07.023174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:07.023544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:07.169968 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:07.178707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b677c3c-b99d-47f6-b928-7aca67f73144 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.168727 Aug 29 20:16:07.179629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 186/359] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:07 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:07.248728 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:07.249394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:07.257343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:07.257969 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:07.258447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:07.259233 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:07.259714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:07.260156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:07.399952 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:07.409249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40c05e9a-644a-414f-a706-0068cea7fc0d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.164545 Aug 29 20:16:07.409867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 187/360] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:07 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:07.903917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:07.904576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:07.906554 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:07.914012 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:07.914523 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:07.914961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:07.915774 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:07.916363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:07.916790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:08.065308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:08.074176 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:08.075685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:08.076875 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99f54603-61b9-4467-8b7c-cb767627bfdd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.176956 Aug 29 20:16:08.077432 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 188/361] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:07 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:08.201543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:08.201543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:08.210264 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:08.210264 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:08.210743 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:08.212036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:08.212906 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:08.213526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:08.238520 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:08.366701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:08.374701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d2f2ad84-2d6a-4abb-b082-868e6aa41793 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.179389 Aug 29 20:16:08.375490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 189/362] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:08 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:08.431707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:08.432305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:08.438262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:08.438747 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:08.439208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:08.439906 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:08.440351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:08.440771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:08.593593 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:08.604040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6e56728-8214-46bf-a70b-c075affc9faa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.176182 Aug 29 20:16:08.611565 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 190/363] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:08 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:08.618888 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0d38574a-ccc8-40ef-9c60-ff7df51faea2 req-d3459726-b6db-4d3f-8643-4fdc896c6017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee34ea9-ae27-4156-8f42-17d06286bebe", "name": "network-vif-plugged", "status": "completed", "tag": "a973a1f7-934c-4d30-ac16-cec9f03a8bfe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:08.630544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0d38574a-ccc8-40ef-9c60-ff7df51faea2 req-d3459726-b6db-4d3f-8643-4fdc896c6017 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:08.631428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0d38574a-ccc8-40ef-9c60-ff7df51faea2 req-d3459726-b6db-4d3f-8643-4fdc896c6017 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:08.631917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0d38574a-ccc8-40ef-9c60-ff7df51faea2 req-d3459726-b6db-4d3f-8643-4fdc896c6017 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:08.646817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0d38574a-ccc8-40ef-9c60-ff7df51faea2 req-d3459726-b6db-4d3f-8643-4fdc896c6017 service nova] Creating event network-vif-plugged:a973a1f7-934c-4d30-ac16-cec9f03a8bfe for instance 2ee34ea9-ae27-4156-8f42-17d06286bebe on hv-cinder-85426 Aug 29 20:16:08.653947 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0d38574a-ccc8-40ef-9c60-ff7df51faea2 req-d3459726-b6db-4d3f-8643-4fdc896c6017 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040962 Aug 29 20:16:08.655304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 191/364] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:09.101438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:09.102130 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:09.109428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:09.109995 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:09.110442 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:09.111202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:09.111661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:09.112117 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:09.268663 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:09.277229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:09.278722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:09.279965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b4bfee1-eec1-4aaf-846b-939eb3b905ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.183271 Aug 29 20:16:09.280547 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 192/365] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:09 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:09.396496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:09.397213 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:09.403353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:09.403905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:09.404399 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:09.405155 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:09.405678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:09.406160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:09.543414 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:09.551682 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bef5620d-fecf-4abb-884a-f04ed1282a5d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.159502 Aug 29 20:16:09.552592 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 193/366] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:09 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:09.625726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:09.626447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:09.633238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:09.633727 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:09.634164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:09.634901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:09.635369 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:09.635796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:09.775535 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:09.794696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a4a2efd-d298-4624-b222-cd915d3d0e63 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.172715 Aug 29 20:16:09.799126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 194/367] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:09 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:10.142220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] validate_networks() for [('5d90d67e-b915-4e8e-aedc-6d41260ae197', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:16:10.304960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:10.305600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:10.322540 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.325188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.325188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.326153 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.328503 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.329320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.696383 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:10.704611 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:10.706041 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:10.707843 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a10b0376-28af-498c-8683-4ef15cc2baf2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.407879 Aug 29 20:16:10.708403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 195/368] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:10 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:10.717224 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:10.717938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:10.725099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.725699 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.726129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.726827 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.727306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.727735 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.752103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=78 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:10.861146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:16:10.861826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:16:10.862456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:16:10.863328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:16:10.863763 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:16:10.873428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.874157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.874756 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.875711 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.876350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.876959 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.902231 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:10.910830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b6c287b-e4f3-4ba6-826a-ff03f4da15b3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.196925 Aug 29 20:16:10.911106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for project eaabbc4be9754bcda6adc796a0340c49. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:16:10.911651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 196/369] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:10 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:10.916400 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Getting quotas for user 58bf9cf55cfc45d3841366f601abe4f8 and project eaabbc4be9754bcda6adc796a0340c49. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:16:10.917217 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:10.917837 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:10.923869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.924729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.924859 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.925557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:10.926022 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:10.926449 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:10.930716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:16:10.933168 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:16:10.983819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7ad8edb8-1ffa-44da-a04d-a3cab7fb2d26 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.969402 Aug 29 20:16:10.985001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 174/370] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:16:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 9971 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:16:10.995754 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-09df4cc9-55b3-491c-9e8a-acfe6645a007 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:10.996401 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-09df4cc9-55b3-491c-9e8a-acfe6645a007 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:11.076534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-09df4cc9-55b3-491c-9e8a-acfe6645a007 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:11.091454 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-09df4cc9-55b3-491c-9e8a-acfe6645a007 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1250 microversion: 2.1 time: 0.099427 Aug 29 20:16:11.092640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 175/371] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:10 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:11.122902 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:11.156824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db562bb5-5e45-4f38-b4c0-abb52af4d8bd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.241885 Aug 29 20:16:11.158484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 197/372] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:10 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:11.732649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:11.733398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:11.741908 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:11.752012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:11.752807 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:11.754140 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:11.755161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:11.755779 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:11.756376 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:11.953489 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:11.954539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:11.974469 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:11.977072 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:11.977885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:11.978895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:11.980518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:11.981393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:11.994968 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:12.003186 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:12.005396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:12.009125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5f9eb2ca-8d72-4801-81b1-e3adb1a91338 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.278001 Aug 29 20:16:12.010010 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 176/373] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:11 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:12.121011 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:12.122219 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:12.139884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:12.164719 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:12.165634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:12.167299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:12.178171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:12.178693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:12.224288 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:12.239815 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23088106-06e0-4e1d-bc54-8912e1fb3958 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.305418 Aug 29 20:16:12.251664 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 198/374] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:11 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:12.254233 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:12.257607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:12.270697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:12.274684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:12.274983 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:12.275751 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:12.278227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:12.278691 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:12.328335 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:12.342344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b236de05-41c2-4dd5-82e5-7a81a35c27ed tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1302 microversion: 2.1 time: 0.225479 Aug 29 20:16:12.343438 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 177/375] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:12 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1302 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:12.733152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-1c6bbfa3-ce66-4a14-a658-ba5d2f7d1b3d req-9261e967-0e04-4c45-8d21-a0b3932824a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af99cf2b-b549-400f-bad3-1bf633c6a2c4", "name": "network-vif-plugged", "status": "completed", "tag": "560f6043-4fba-46ff-bc9d-77f769ad7a55"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:12.755364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1c6bbfa3-ce66-4a14-a658-ba5d2f7d1b3d req-9261e967-0e04-4c45-8d21-a0b3932824a5 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:12.758142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1c6bbfa3-ce66-4a14-a658-ba5d2f7d1b3d req-9261e967-0e04-4c45-8d21-a0b3932824a5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:12.758798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1c6bbfa3-ce66-4a14-a658-ba5d2f7d1b3d req-9261e967-0e04-4c45-8d21-a0b3932824a5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:12.792088 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-1c6bbfa3-ce66-4a14-a658-ba5d2f7d1b3d req-9261e967-0e04-4c45-8d21-a0b3932824a5 service nova] Creating event network-vif-plugged:560f6043-4fba-46ff-bc9d-77f769ad7a55 for instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 on hv-cinder-85426 Aug 29 20:16:12.808268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-1c6bbfa3-ce66-4a14-a658-ba5d2f7d1b3d req-9261e967-0e04-4c45-8d21-a0b3932824a5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078480 Aug 29 20:16:12.809528 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 178/376] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:16:12.858244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:12.869570 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20bee491-4733-4d8c-a4fd-8a7aeb7dbc1a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.625799 Aug 29 20:16:12.874519 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 199/377] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:12 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:13.041508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:13.042162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:13.062885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.067788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.071450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:13.072547 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.074140 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.076572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:13.264028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:13.265928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:13.281109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.298121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.299065 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:13.300287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.301066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.301731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:13.513429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:13.526455 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:13.528299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:13.535731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-51ec9984-454c-46cf-8ffc-453c05db2267 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.498484 Aug 29 20:16:13.551472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 179/378] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:13 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:13.561796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:13.576402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:13.588856 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.591882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.595414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:13.596598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.597499 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.598196 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:13.798060 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:13.808451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-19f18a28-7e72-4562-834c-05852c96e767 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1308 microversion: 2.1 time: 0.255453 Aug 29 20:16:13.828223 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 180/379] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:13 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:13.853617 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:13.873884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83b8a487-a8a7-4dab-95bd-78bca7367eff tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.613666 Aug 29 20:16:13.874867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 200/380] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:13 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:13.896944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:13.897822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:13.905167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.906283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.906729 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:13.907480 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:13.907940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:13.908908 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:14.128001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:14.138814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2eb414ec-828e-4790-839a-b96fbb46f6ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.245981 Aug 29 20:16:14.139964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 181/381] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:13 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:14.570804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:14.572422 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:14.592483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:14.592973 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:14.593413 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:14.594119 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:14.594574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:14.594997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:14.848373 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:14.849946 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:14.877728 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:14.894860 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:14.895899 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:14.905279 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:14.906006 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:14.906713 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:15.050701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:15.068263 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:15.070755 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:15.072283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c0418f1-6150-4c8b-bcde-3c9ccb9d8774 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.510136 Aug 29 20:16:15.073344 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 201/382] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:14 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:15.092597 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:15.093544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:15.106934 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:15.107725 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:15.114032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:15.115200 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:15.115846 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:15.116425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:15.255511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:15.272313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-12c51e15-df47-44aa-a97b-4297a9e8e049 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.432371 Aug 29 20:16:15.272988 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 182/383] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:14 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:15.293176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:15.293810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:15.314857 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:15.316081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:15.316866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:15.317876 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:15.319630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:15.321249 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:15.398530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:15.409083 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bed10fa5-162f-4576-a5c6-8ed369784788 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.334376 Aug 29 20:16:15.410396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 202/384] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:15 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:15.676666 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:15.684626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-eb45d45f-18b8-4a1b-8961-3f7defef325c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.410570 Aug 29 20:16:15.685486 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 183/385] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:15 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:16.099869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:16.100480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:16.113962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.116862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.120024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.121615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.122238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.124278 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.298605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:16.305457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:16.323711 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:16.327506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.328074 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.328585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.331890 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.333561 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.334002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.344840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:16.348504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:16.350993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70558cde-29f4-4f4f-99a2-cff02469e1e2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.254751 Aug 29 20:16:16.380071 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 203/386] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:16 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:16.431355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:16.431970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:16.442622 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.443139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.443593 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.444278 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.444737 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.445161 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.573504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:16.583154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4389e57d-5634-4c37-bf44-d90161627a98 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.292996 Aug 29 20:16:16.585639 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 184/387] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:16 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:16.590215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-240adf9e-b9d7-4bf6-ba02-d57ba9f23a47 req-333fd910-099d-4d27-95eb-47be57e8a9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89712622-db65-462f-a0eb-356e69bbadb3", "tag": "3bbced07-f74b-4bb6-92a2-a4de1b3dba60"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:16.601428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-240adf9e-b9d7-4bf6-ba02-d57ba9f23a47 req-333fd910-099d-4d27-95eb-47be57e8a9f2 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.602104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-240adf9e-b9d7-4bf6-ba02-d57ba9f23a47 req-333fd910-099d-4d27-95eb-47be57e8a9f2 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.602639 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-240adf9e-b9d7-4bf6-ba02-d57ba9f23a47 req-333fd910-099d-4d27-95eb-47be57e8a9f2 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.614577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-240adf9e-b9d7-4bf6-ba02-d57ba9f23a47 req-333fd910-099d-4d27-95eb-47be57e8a9f2 service nova] Creating event network-changed:3bbced07-f74b-4bb6-92a2-a4de1b3dba60 for instance 89712622-db65-462f-a0eb-356e69bbadb3 on hv-cinder-85426 Aug 29 20:16:16.661941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-240adf9e-b9d7-4bf6-ba02-d57ba9f23a47 req-333fd910-099d-4d27-95eb-47be57e8a9f2 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076349 Aug 29 20:16:16.665239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 185/388] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:16.709278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:16.710247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:16.750085 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.750832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.751441 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.752708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:16.753906 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:16.754477 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:16.778667 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:16.798108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d43f3760-f811-4389-b326-5975859de002 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1267 microversion: 2.1 time: 0.371285 Aug 29 20:16:16.798696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 204/389] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:16 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1267 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:17.103268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e8ba133e-c377-4271-a571-99344167f46e req-c7b5dd37-b8af-49d1-9f91-e9a9266daae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce8543-4378-4a6f-b1ce-c98e6321ec59", "name": "network-vif-plugged", "status": "completed", "tag": "1db8c83e-b525-40c2-96a4-682d0468352c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:17.123808 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8ba133e-c377-4271-a571-99344167f46e req-c7b5dd37-b8af-49d1-9f91-e9a9266daae6 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:17.124323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8ba133e-c377-4271-a571-99344167f46e req-c7b5dd37-b8af-49d1-9f91-e9a9266daae6 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:17.124723 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8ba133e-c377-4271-a571-99344167f46e req-c7b5dd37-b8af-49d1-9f91-e9a9266daae6 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:17.138483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:17.144842 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e8ba133e-c377-4271-a571-99344167f46e req-c7b5dd37-b8af-49d1-9f91-e9a9266daae6 service nova] Creating event network-vif-plugged:1db8c83e-b525-40c2-96a4-682d0468352c for instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 on hv-cinder-85426 Aug 29 20:16:17.152775 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-41aac5d3-5766-44a5-a9f8-a6d6dede8f2b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.447592 Aug 29 20:16:17.154094 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 186/390] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:16 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:17.182611 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e8ba133e-c377-4271-a571-99344167f46e req-c7b5dd37-b8af-49d1-9f91-e9a9266daae6 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082872 Aug 29 20:16:17.191435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 205/391] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:17.399216 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:17.400910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:17.422308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:17.426741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:17.427234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:17.427960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:17.428423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:17.428851 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:17.604993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:17.606104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:17.620522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:17.622186 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:17.623372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:17.625892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:17.626863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:17.630151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:17.678071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:17.687271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:17.688729 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:17.689949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6f9ace13-347f-4897-8f7a-3565f1a46452 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.297672 Aug 29 20:16:17.691445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 187/392] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:17 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:17.827511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:17.827511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:17.829632 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:17.837941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:17.838629 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:17.839160 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:17.844473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2165cc43-870a-429b-93c3-9487aed8792e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.244093 Aug 29 20:16:17.854706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 206/393] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:17 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:17.860940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:17.861724 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:17.862188 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.059801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:18.069937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-502b6bed-c1c4-4ebb-9811-cb549f23f9fb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1454 microversion: 2.1 time: 0.251287 Aug 29 20:16:18.080540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 188/394] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:17 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1454 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:18.093791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:18.094589 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:18.101140 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.101998 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.102650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.103686 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.104830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.104954 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.130537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:18.177119 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:18.177733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:18.187800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.188535 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.189492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.190495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.191342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.191993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.301004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:18.313189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-789e1c8e-a157-47eb-99fc-7136da43c689 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1454 microversion: 2.1 time: 0.223224 Aug 29 20:16:18.313812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 207/395] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:18 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:18.405982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:18.417458 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7d49d863-81fa-4c0e-9c3c-11d4be92e78d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.244406 Aug 29 20:16:18.419116 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 189/396] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:18 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:18.713612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:18.714537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:18.725419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.727151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.732507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.733580 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.734329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.734986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.865738 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:18.866478 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:18.877959 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.878688 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.887484 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:18.888323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:18.892837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:18.895944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:19.075619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:19.091031 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:19.093949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:19.095639 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b25df005-afab-4938-b71d-e52e3ae94bcb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.385847 Aug 29 20:16:19.116162 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 208/397] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:18 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:19.133363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:19.142394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-20b6bcb4-27fc-49a7-94b2-18edcde4473c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.281183 Aug 29 20:16:19.142972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 190/398] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:18 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:19.437749 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:19.438985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:19.449370 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:19.452545 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:19.453436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:19.454398 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:19.455064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:19.457543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:19.796813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:19.814653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33bdcca0-9a66-46d1-8092-0bffc0799a5d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1371 microversion: 2.1 time: 0.379927 Aug 29 20:16:19.817788 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 209/399] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:19 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1371 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:20.124240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:20.125511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:20.141318 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:20.142316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:20.143021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:20.144704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:20.146755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:20.153105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:20.163312 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:20.164654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:20.183717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:20.183717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:20.184179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:20.184924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:20.185397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:20.185829 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:20.561725 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:20.572164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bc625c8-6d96-498b-9368-2c16982f6897 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.414102 Aug 29 20:16:20.574532 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 210/400] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:20 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:20.599539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:20.614087 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:20.615769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:20.616965 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-525c2a4c-d712-4a71-9844-d635f1a81f08 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.497100 Aug 29 20:16:20.632912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 191/401] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:20 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:20.845329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:20.847413 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:20.870697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:20.877915 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:20.878751 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:20.883319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:20.884431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:20.888209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:21.351426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:21.363928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59689420-05c6-4bc0-8023-85945be46dd8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1562 microversion: 2.1 time: 0.529570 Aug 29 20:16:21.376185 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 211/402] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:20 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1562 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:21.387781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:21.388903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:21.390942 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:21.391836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=8 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:21.408217 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:21.409808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:21.412545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:21.413546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:21.414977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:21.416024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:21.568987 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-54565cd2-3d4f-41a9-bdd0-a85fbc216a2d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185417 Aug 29 20:16:21.570134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 192/403] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:16:21 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:21.598976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:21.602783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:21.632285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:21.632779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:21.638781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:21.640022 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:21.640660 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:21.641247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:21.655576 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:21.660152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:21.677564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:21.679422 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:21.682023 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:21.683949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:21.686715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:21.691036 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:22.229714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:22.244867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b6151c1-ba85-4a74-b21a-dfa8c118c3e1 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.650803 Aug 29 20:16:22.255765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 212/404] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:21 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:22.267545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:22.274352 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=100 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:22.279338 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:22.283033 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:22.287459 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2f0ae846-6c92-4f15-a7d4-4b08e2567c74 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.636963 Aug 29 20:16:22.290910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 193/405] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:21 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:22.317753 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e256f264-18b9-425d-bba9-da6c9812487f req-2cfe57e7-687b-4d3b-9f0a-b4ebab53c904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af99cf2b-b549-400f-bad3-1bf633c6a2c4", "tag": "560f6043-4fba-46ff-bc9d-77f769ad7a55"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:22.341623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e256f264-18b9-425d-bba9-da6c9812487f req-2cfe57e7-687b-4d3b-9f0a-b4ebab53c904 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:22.342127 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e256f264-18b9-425d-bba9-da6c9812487f req-2cfe57e7-687b-4d3b-9f0a-b4ebab53c904 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:22.342568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e256f264-18b9-425d-bba9-da6c9812487f req-2cfe57e7-687b-4d3b-9f0a-b4ebab53c904 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:22.378979 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e256f264-18b9-425d-bba9-da6c9812487f req-2cfe57e7-687b-4d3b-9f0a-b4ebab53c904 service nova] Creating event network-changed:560f6043-4fba-46ff-bc9d-77f769ad7a55 for instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 on hv-cinder-85426 Aug 29 20:16:22.400904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e256f264-18b9-425d-bba9-da6c9812487f req-2cfe57e7-687b-4d3b-9f0a-b4ebab53c904 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087256 Aug 29 20:16:22.401515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 213/406] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:23.281142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:23.286416 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:23.300972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:23.301847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:23.303611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:23.305777 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:23.306660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:23.313780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:23.315064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:23.318834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:23.329616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:23.337951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:23.341192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:23.344425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:23.353676 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:23.354784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:23.637836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:23.647585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-15d35e1b-7fa6-4241-a1e7-6f2dd3d347dc tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.379784 Aug 29 20:16:23.678280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 194/407] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:23 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:23.693460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-372ed728-0697-4dfa-b3c7-3d2478c48934 req-15d21401-2e79-4650-87a0-b72c98d93f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89712622-db65-462f-a0eb-356e69bbadb3", "name": "network-vif-plugged", "status": "completed", "tag": "3bbced07-f74b-4bb6-92a2-a4de1b3dba60"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:23.720137 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-372ed728-0697-4dfa-b3c7-3d2478c48934 req-15d21401-2e79-4650-87a0-b72c98d93f37 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:23.721186 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-372ed728-0697-4dfa-b3c7-3d2478c48934 req-15d21401-2e79-4650-87a0-b72c98d93f37 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:23.722097 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-372ed728-0697-4dfa-b3c7-3d2478c48934 req-15d21401-2e79-4650-87a0-b72c98d93f37 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:23.747353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-372ed728-0697-4dfa-b3c7-3d2478c48934 req-15d21401-2e79-4650-87a0-b72c98d93f37 service nova] Creating event network-vif-plugged:3bbced07-f74b-4bb6-92a2-a4de1b3dba60 for instance 89712622-db65-462f-a0eb-356e69bbadb3 on hv-cinder-85426 Aug 29 20:16:23.763558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-372ed728-0697-4dfa-b3c7-3d2478c48934 req-15d21401-2e79-4650-87a0-b72c98d93f37 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083400 Aug 29 20:16:23.766987 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 195/408] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:23.790646 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:23.806008 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:23.810769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:23.813704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f748fe0b-0d07-456d-9482-8a976fbe1a8b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.504177 Aug 29 20:16:23.814493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 214/409] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:23 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:24.532803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-ce23baa2-bd99-4dbd-b064-d47a276cbf3e req-be0fdb4a-dd7c-4d44-a2cf-63fd0095ac3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce8543-4378-4a6f-b1ce-c98e6321ec59", "tag": "1db8c83e-b525-40c2-96a4-682d0468352c"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:24.558904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-ce23baa2-bd99-4dbd-b064-d47a276cbf3e req-be0fdb4a-dd7c-4d44-a2cf-63fd0095ac3a service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:24.559996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-ce23baa2-bd99-4dbd-b064-d47a276cbf3e req-be0fdb4a-dd7c-4d44-a2cf-63fd0095ac3a service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:24.561981 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-ce23baa2-bd99-4dbd-b064-d47a276cbf3e req-be0fdb4a-dd7c-4d44-a2cf-63fd0095ac3a service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:24.605758 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-ce23baa2-bd99-4dbd-b064-d47a276cbf3e req-be0fdb4a-dd7c-4d44-a2cf-63fd0095ac3a service nova] Creating event network-changed:1db8c83e-b525-40c2-96a4-682d0468352c for instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 on hv-cinder-85426 Aug 29 20:16:24.616408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-ce23baa2-bd99-4dbd-b064-d47a276cbf3e req-be0fdb4a-dd7c-4d44-a2cf-63fd0095ac3a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088330 Aug 29 20:16:24.617324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 196/410] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:24.687267 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:24.688144 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:24.700001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:24.701777 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:24.703755 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:24.704767 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:24.714914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:24.715652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:24.840261 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:24.841171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:24.854660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:24.855184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:24.855625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:24.856339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:24.863905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:24.864496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:25.093513 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:25.102537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-274a5c33-2215-4cdb-8547-411ea704dd31 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.420655 Aug 29 20:16:25.103124 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 215/411] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:24 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:25.177599 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:25.191534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:25.204388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:25.206032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a1124532-1233-4944-a4f1-fecffe0146dc tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.370477 Aug 29 20:16:25.209915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 197/412] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:24 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:26.128375 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:26.128980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:26.139403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:26.139917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:26.140353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:26.141058 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:26.141522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:26.141948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:26.230903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:26.231539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:26.265399 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:26.265892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:26.266328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:26.267038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:26.275615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:26.276072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:26.608585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:26.620329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5b81978-e821-4a65-aee7-9b82d7c5b708 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1373 microversion: 2.1 time: 0.500406 Aug 29 20:16:26.621630 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 216/413] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:26 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1373 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:26.636695 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:26.644867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:26.646368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:26.647564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f5222835-b642-4db6-b569-14a0d67b2eb1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.420612 Aug 29 20:16:26.648122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 198/414] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:26 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:27.641810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:27.642652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:27.649032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:27.649517 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:27.649948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:27.650644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:27.651114 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:27.651535 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:27.675864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:27.676797 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:27.683318 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:27.683809 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:27.684251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:27.684953 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:27.685413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:27.685841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:27.834681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:27.842586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b94f6f47-b602-45dd-82fc-1e7df9bdcf0d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1567 microversion: 2.1 time: 0.204870 Aug 29 20:16:27.848736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 217/415] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:16:27 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:27.859781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:27.863348 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:27.863844 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:27.868615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:27.869690 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:27.870056 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:27.870183 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:27.870596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:27.871228 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-321c2aeb-5b33-4a3c-bb2e-251e1a2622d4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1743 microversion: 2.20 time: 0.200014 Aug 29 20:16:27.871350 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:27.871951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:27.872083 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 199/416] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:27 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1743 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:27.872247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:27.954816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df31550a-3ab0-426a-b0c8-22af6fbe5c59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096117 Aug 29 20:16:27.955611 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 218/417] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:16:27 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:16:28.894389 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:28.894997 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:28.901388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:28.901868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:28.902303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:28.902992 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:28.903504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:28.903928 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:29.107895 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:29.116787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:29.118233 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:29.119414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6f5383b7-95af-4d56-b91f-f1c8ec6bd192 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.228936 Aug 29 20:16:29.119974 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 200/418] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:28 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:29.251176 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ccfd86e4-224c-423d-b728-e20fb39fa408 req-ea88e794-133a-47f6-a5af-df3b409b1530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89712622-db65-462f-a0eb-356e69bbadb3", "tag": "3bbced07-f74b-4bb6-92a2-a4de1b3dba60"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:29.261190 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ccfd86e4-224c-423d-b728-e20fb39fa408 req-ea88e794-133a-47f6-a5af-df3b409b1530 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:29.261745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ccfd86e4-224c-423d-b728-e20fb39fa408 req-ea88e794-133a-47f6-a5af-df3b409b1530 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:29.262239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ccfd86e4-224c-423d-b728-e20fb39fa408 req-ea88e794-133a-47f6-a5af-df3b409b1530 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:29.275697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ccfd86e4-224c-423d-b728-e20fb39fa408 req-ea88e794-133a-47f6-a5af-df3b409b1530 service nova] Creating event network-changed:3bbced07-f74b-4bb6-92a2-a4de1b3dba60 for instance 89712622-db65-462f-a0eb-356e69bbadb3 on hv-cinder-85426 Aug 29 20:16:29.281129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ccfd86e4-224c-423d-b728-e20fb39fa408 req-ea88e794-133a-47f6-a5af-df3b409b1530 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034092 Aug 29 20:16:29.282002 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 219/419] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:30.145817 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:30.146454 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:30.153757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:30.154324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:30.154836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:30.155707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:30.156257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:30.156749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:30.298192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:30.307679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:30.309316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:30.310928 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2debbb04-bf4f-4b35-91fd-ddc7a5a26275 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.169555 Aug 29 20:16:30.311723 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 201/420] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:30 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:31.336301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:31.337031 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:31.343783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:31.344267 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:31.344702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:31.345460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:31.346436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:31.346896 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:31.483484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:31.491613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:31.493060 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:31.494255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de710ac4-1442-4b18-a787-3e3aefec993b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.162322 Aug 29 20:16:31.494817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 220/421] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:31 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:32.514560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-bb048826-f143-4c2a-a994-999fa29e450e req-0b0dd4bb-b80d-4a66-95fb-3049b61634b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee34ea9-ae27-4156-8f42-17d06286bebe", "name": "network-vif-unplugged", "status": "completed", "tag": "a973a1f7-934c-4d30-ac16-cec9f03a8bfe"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:32.516810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:32.518069 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:32.526828 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:32.527475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:32.527637 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-bb048826-f143-4c2a-a994-999fa29e450e req-0b0dd4bb-b80d-4a66-95fb-3049b61634b4 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:32.527961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:32.528092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-bb048826-f143-4c2a-a994-999fa29e450e req-0b0dd4bb-b80d-4a66-95fb-3049b61634b4 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:32.528475 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-bb048826-f143-4c2a-a994-999fa29e450e req-0b0dd4bb-b80d-4a66-95fb-3049b61634b4 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:32.531630 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:32.532265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:32.533443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:32.542383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-bb048826-f143-4c2a-a994-999fa29e450e req-0b0dd4bb-b80d-4a66-95fb-3049b61634b4 service nova] Creating event network-vif-unplugged:a973a1f7-934c-4d30-ac16-cec9f03a8bfe for instance 2ee34ea9-ae27-4156-8f42-17d06286bebe on hv-cinder-85426 Aug 29 20:16:32.547660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-bb048826-f143-4c2a-a994-999fa29e450e req-0b0dd4bb-b80d-4a66-95fb-3049b61634b4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037059 Aug 29 20:16:32.548248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 202/422] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:16:32.670764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:32.680543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:32.682140 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:32.683705 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a99ac908-4027-48d5-9a61-e821ee97afd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.171014 Aug 29 20:16:32.684276 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 221/423] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:32 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:33.707573 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:33.708236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:33.715881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:33.716378 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:33.716816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:33.717546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:33.717987 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:33.718423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:33.858810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:33.867819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:33.869241 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:33.870381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1a1622ca-ad73-4bfb-8b2e-2c765c6331e8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.167632 Aug 29 20:16:33.871060 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 203/424] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:33 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:34.895280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:34.895772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:34.898222 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=88 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:34.903636 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:34.904113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:34.904546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:34.905236 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:34.905685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:34.906104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:35.038743 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:35.047187 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:35.049473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:35.050819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58db096b-f602-4943-8a43-ccaad56e760f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.159723 Aug 29 20:16:35.051591 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 222/425] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:34 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:36.075104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:36.075708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:36.083139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:36.083634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:36.084074 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:36.084797 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:36.085275 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:36.085702 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:36.221441 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:36.229434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:36.230854 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:36.232029 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2c6065c8-92de-44fc-91db-44b76708fdc0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.160906 Aug 29 20:16:36.232633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 204/426] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:36 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:37.255877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:37.256480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:37.262802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:37.263323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:37.263755 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:37.264434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:37.264886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:37.265303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:37.408097 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:37.417227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:37.418669 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:37.419929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61295471-f403-4768-988b-28efa06de362 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1725 microversion: 2.20 time: 0.167940 Aug 29 20:16:37.420705 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 223/427] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:37 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:38.444372 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:38.444970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:38.451095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:38.451577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:38.452011 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:38.452691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:38.453139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:38.453556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:38.590210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:38.598307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:38.599788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:38.600937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6bc86dda-0e23-4395-ae57-fb382da98ecd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1668 microversion: 2.20 time: 0.160496 Aug 29 20:16:38.601496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 205/428] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:38 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:38.623059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3972c325-ab25-4688-88a2-12b348ffbd49"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:38.625468 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:38.632462 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:38.632942 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:38.633371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:38.634061 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:38.634514 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:38.634935 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:38.813550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:38.919039 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a0b5b17-a90b-4755-b7be-dc9ea763dc93 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299868 Aug 29 20:16:38.925273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 224/429] 10.222.0.121 () {62 vars in 1369 bytes} [Mon Aug 29 20:16:38 2022] POST /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:16:39.041800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:16:39.042400 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:39.048938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.049431 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.049871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.050567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.051027 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.051481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.093218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120721) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:16:39.168874 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b10e595d-1697-4d66-abb2-25bdaef8e14f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/action" status: 202 len: 0 microversion: 2.20 time: 0.131262 Aug 29 20:16:39.169736 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 206/430] 10.222.0.121 () {62 vars in 1324 bytes} [Mon Aug 29 20:16:39 2022] POST /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:39.178509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:39.179139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:39.185631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.186112 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.186539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.187255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:39.187704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:39.188277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:39.329035 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:39.338079 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:39.339639 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:39.340877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04243988-edc1-486d-947a-a6dca249fa0e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1754 microversion: 2.20 time: 0.166270 Aug 29 20:16:39.341521 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 225/431] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:39 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:40.365941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:40.366524 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:40.372412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:40.372894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:40.373328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:40.374016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:40.374471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:40.374896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:40.506246 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:40.514712 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:40.516163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:40.517313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e2859e8a-8429-4ffd-b335-d10b3975c75f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1754 microversion: 2.20 time: 0.156194 Aug 29 20:16:40.517865 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 207/432] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:40 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:41.539959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:41.540501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:41.546800 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:41.547312 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:41.547772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:41.548593 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:41.549039 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:41.549460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:41.674476 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:41.682923 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:41.684382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:41.685522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0539108e-6ef9-45e9-80a6-c299b305d992 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1754 microversion: 2.20 time: 0.149527 Aug 29 20:16:41.686081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 226/433] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:41 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:42.710197 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:42.710765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:42.713341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:42.718510 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:42.718991 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:42.720060 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:42.720882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:42.721391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:42.721749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:42.857481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.866558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.868012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:42.869168 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-682a87b0-bea7-4902-843f-151965053e5a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1756 microversion: 2.20 time: 0.162765 Aug 29 20:16:42.869719 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 208/434] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:42 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:43.895358 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:43.896202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:43.904209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:43.904722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:43.905156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:43.905861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:43.906346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:43.908195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:44.051731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:44.060404 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:44.061911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:44.063129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e856d89a-0c74-4d9e-b4f8-ce75b819637f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.173546 Aug 29 20:16:44.064259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 227/435] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:43 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:16:45.087428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:45.088045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:45.095575 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:45.096000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:45.096436 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:45.097231 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:45.097784 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:45.098245 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:45.232814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:45.242397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:45.243867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:45.245072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-36b53f36-0a62-483e-80f5-cea6ebb89b73 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.161593 Aug 29 20:16:45.245674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 209/436] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:45 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:46.269833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:46.270413 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:46.277004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:46.277483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:46.277913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:46.278604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:46.279053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:46.279496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:46.409538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.418040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.419506 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:46.420711 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9cf5a2ed-eb43-4a40-bd01-b8c888563c4a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.156324 Aug 29 20:16:46.421266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 228/437] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:46 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:47.444554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:47.445094 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:47.451490 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.451978 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.452414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:47.453106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:47.454156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:47.454614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:47.584202 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:47.592721 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:47.594210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:47.595378 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ab6686fb-1c78-4938-9a22-3e99578c4bd3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.154798 Aug 29 20:16:47.595931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 210/438] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:47 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:48.618024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:48.618629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:48.625026 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:48.626174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:48.626602 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:48.627309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:48.627759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:48.628216 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:48.761391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.770207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.771776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:48.773300 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8566a809-e561-412c-b2ab-eebffcf8ca86 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.159129 Aug 29 20:16:48.774409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 229/439] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:48 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:49.796761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:49.798251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:49.805083 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.805573 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.806010 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:49.806708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:49.807192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:49.807618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:49.825949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.953169 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:49.961918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:49.963403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:49.964541 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-585de35e-ce73-4f1e-bb4c-80be173e47b0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.171837 Aug 29 20:16:49.965103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 211/440] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:49 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:50.987546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:50.988174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:50.994691 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:50.995199 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:50.995632 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:50.996327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:50.996779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:50.997197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:51.135493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:51.144287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:51.145694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:51.146873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-186a5bbe-4511-4d7e-a37a-737c37b05c41 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.163805 Aug 29 20:16:51.147643 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 230/441] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:50 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:52.176808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:52.178048 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:52.185752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:52.186495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:52.187103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:52.188069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:52.188980 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:52.189568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:52.387212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.416982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.419286 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:52.420735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8073418a-1708-4c87-8374-5266ccf721fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.252538 Aug 29 20:16:52.421908 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 212/442] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:52 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:53.449760 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:53.450363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:53.457470 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:53.457955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:53.458388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:53.459109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:53.459559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:53.459982 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:53.595431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:53.604303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:53.605752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:53.606922 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f12d128d-e870-44af-a8ec-212e40d30ef7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.161091 Aug 29 20:16:53.607572 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 231/443] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:53 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:54.630398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:54.630995 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:54.637631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:54.638122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:54.638564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:54.639368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:54.639832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:54.640870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:54.783929 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.792979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.794414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:54.795628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-381a6c77-009a-46df-b22b-5e527e9b7d4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.169102 Aug 29 20:16:54.796217 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 213/444] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:54 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:55.818752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:55.819560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:55.827882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.828459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.828967 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.829767 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:55.830450 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:55.830886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:55.970479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:55.979651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:55.981319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:55.982482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bda794b5-7008-4841-af94-99268ddbc328 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.167675 Aug 29 20:16:55.983027 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 232/445] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:55 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:57.005590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:57.006345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:57.013220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.013706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.014139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.014840 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:57.015945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:57.016483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:57.185141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.195250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.196791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:57.198069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fcaf6eb3-fead-435a-a0db-da3f75af2592 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.196358 Aug 29 20:16:57.198703 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 214/446] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:57 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:58.222746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:58.223480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:58.230298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:58.230790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:58.231290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:58.231992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:58.232449 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:58.232914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:58.373924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.383054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.384530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:58.385712 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd08e01e-1fb1-453c-a494-16d0c16a6c43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.167774 Aug 29 20:16:58.386409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 233/447] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:58 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:16:59.411411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:16:59.412646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:16:59.420947 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.421800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.422549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.423364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:16:59.424172 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:16:59.424646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:16:59.574185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:59.583044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:59.584519 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:16:59.585681 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-365e2f5a-f233-4f77-95b5-9e0d8a12a733 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.180104 Aug 29 20:16:59.586237 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 215/448] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:16:59 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:00.610269 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:00.610847 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:00.617402 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:00.617882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:00.618402 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:00.619017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:00.619501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:00.619928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:00.768015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:00.777108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:00.778872 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:00.780082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02f4b881-0d28-4b72-96f4-d2dde4aee644 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.174229 Aug 29 20:17:00.780736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 234/449] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:00 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:01.802940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:01.804345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:01.810851 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.811313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.812534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.812941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:01.813399 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:01.813819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:01.950457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.960032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.961470 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:01.962625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1042e886-a236-459f-8fde-e475dc14d81c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.163681 Aug 29 20:17:01.963206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 216/450] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:01 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:02.992358 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:02.993025 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:02.999535 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:03.000016 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:03.000460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:03.001152 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:03.001609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:03.002032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:03.127601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.136307 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.137728 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:03.138865 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c8d0554-9c20-4942-b1f9-d96268f356a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.150483 Aug 29 20:17:03.139512 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 235/451] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:02 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:04.162891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:04.163521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:04.169984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.170574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.171884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.172628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:04.173091 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:04.173519 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:04.306585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:04.315904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:04.317338 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:04.318494 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8cbeed94-c99c-47f3-8abf-e32d61185a12 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.159437 Aug 29 20:17:04.319051 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 217/452] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:04 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:05.342120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:05.342848 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:05.345666 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:05.350851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.351377 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.351817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:05.352521 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:05.352980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:05.353410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:05.485224 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:05.494320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:05.495894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:05.497083 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2239c19f-70ff-4364-b1e8-75f96d33e822 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.159129 Aug 29 20:17:05.497628 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 236/453] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:05 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:17:06.520015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:06.520647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:06.526712 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.527236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.527671 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.528355 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:06.528810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:06.529229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:06.668760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.677769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.679330 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:06.680583 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-537ff24e-d0a0-4e12-8750-9f84217d33b8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.164552 Aug 29 20:17:06.681172 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 218/454] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:06 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:07.707594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:07.708180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:07.714626 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.715133 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.715560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.716242 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:07.716726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:07.717150 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:07.849133 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.857911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.860062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:07.861211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7686fb30-4452-4904-9d5b-5b7eacf9196a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.157544 Aug 29 20:17:07.861767 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 237/455] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:07 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:08.884857 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:08.885390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:08.891864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.892358 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.892787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:08.893483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:08.893940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:08.894366 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:09.022507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:09.032995 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:09.034142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:09.035336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3e384c00-6a01-4b35-a4a3-e619ba1ecac5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.154451 Aug 29 20:17:09.035985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 219/456] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:08 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:10.057779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:10.058281 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:10.065367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:10.065855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:10.066293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:10.066994 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:10.067484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:10.067948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:10.071956 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=84,nova_cell1:UPDATE=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:10.205097 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:10.213933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:10.215461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:10.216628 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1305469e-a957-4d5f-b379-57eb7488b626 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.162918 Aug 29 20:17:10.217190 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 238/457] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:10 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:11.239914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:11.240962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:11.247667 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:11.248156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:11.248898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:11.249793 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:11.250689 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:11.251163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:11.381783 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:11.390284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:11.392396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:11.393530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-23e209bf-1a37-4827-ba09-83918fa7f4a2 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.158052 Aug 29 20:17:11.394077 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 220/458] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:11 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:12.416402 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:12.417028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:12.424208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.424683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.425110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.425791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.426240 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.426655 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.731739 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.741015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.742469 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:12.743662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba69386c-bf85-46d7-9aaa-5823dbf44225 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.331178 Aug 29 20:17:12.744223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 239/459] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:12 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:12.773822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-c162fc1e-259b-4845-bb69-5cec3eb8ba0b req-b6077d5d-3081-486d-b408-6b1379dbec05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee34ea9-ae27-4156-8f42-17d06286bebe", "name": "network-vif-plugged", "status": "completed", "tag": "a973a1f7-934c-4d30-ac16-cec9f03a8bfe"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:12.779089 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=26 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:12.785826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-c162fc1e-259b-4845-bb69-5cec3eb8ba0b req-b6077d5d-3081-486d-b408-6b1379dbec05 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:12.786445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-c162fc1e-259b-4845-bb69-5cec3eb8ba0b req-b6077d5d-3081-486d-b408-6b1379dbec05 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:12.786940 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-c162fc1e-259b-4845-bb69-5cec3eb8ba0b req-b6077d5d-3081-486d-b408-6b1379dbec05 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:12.798674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-c162fc1e-259b-4845-bb69-5cec3eb8ba0b req-b6077d5d-3081-486d-b408-6b1379dbec05 service nova] Creating event network-vif-plugged:a973a1f7-934c-4d30-ac16-cec9f03a8bfe for instance 2ee34ea9-ae27-4156-8f42-17d06286bebe on hv-cinder-85426 Aug 29 20:17:12.803746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-c162fc1e-259b-4845-bb69-5cec3eb8ba0b req-b6077d5d-3081-486d-b408-6b1379dbec05 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Aug 29 20:17:12.804342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 221/460] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:13.768482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:13.769052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:13.776467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:13.776745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:13.777178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:13.777861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:13.778317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:13.778735 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:13.908648 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:13.917602 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:13.919220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:13.920663 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5124c6a0-f61a-4c28-9372-c9b295615390 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.156379 Aug 29 20:17:13.922509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 240/461] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:13 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:14.945967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:14.946697 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:14.952990 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.953472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.953913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:14.954606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:14.955068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:14.955526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:15.092905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.101766 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.103407 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:15.104387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-43fdffc3-f940-4584-9bc7-038d0c306699 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1812 microversion: 2.20 time: 0.163382 Aug 29 20:17:15.105092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 222/462] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:14 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:16.128024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:16.128646 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:16.136394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.136882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.137320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.138027 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:16.138488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:16.138915 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:16.269332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.278091 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.279554 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:16.280735 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d2d0020-1e80-4602-970d-c9aaad1ab3de tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1799 microversion: 2.20 time: 0.157430 Aug 29 20:17:16.281550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 241/463] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:17:16 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:17:32.990209 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:32.990809 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:32.993340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.994146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=64 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.001707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.002121 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.002557 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.003287 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.003743 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.004167 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.032353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-288e1d09-66ef-48ba-a283-5a4f52339d9f tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59/ips" status: 200 len: 151 microversion: 2.1 time: 0.045940 Aug 29 20:17:33.032926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 223/464] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:17:32 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:33.044376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cf47f67-3e6a-4396-97a7-fdc7f9921ce6"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:33.046854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:33.049617 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=11 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.050268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=23 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.056228 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.056731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.057160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.057864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.058316 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.058755 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.146266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Invalid volume: volume 6cf47f67-3e6a-4396-97a7-fdc7f9921ce6 is already attached to instances: a078027c-0fda-486c-9f40-ac527c610a4c Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59/os-volume_attachments HTTP/1.1 Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 74 Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:17:33.148043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "6cf47f67-3e6a-4396-97a7-fdc7f9921ce6"}} Aug 29 20:17:33.149610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Invalid volume: volume 6cf47f67-3e6a-4396-97a7-fdc7f9921ce6 is already attached to instances: a078027c-0fda-486c-9f40-ac527c610a4c Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'server_id': '34ce8543-4378-4a6f-b1ce-c98e6321ec59', 'body': {'volumeAttachment': {'volumeId': '6cf47f67-3e6a-4396-97a7-fdc7f9921ce6'}}} Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6cf47f67-3e6a-4396-97a7-fdc7f9921ce6 is already attached to instances: a078027c-0fda-486c-9f40-ac527c610a4c Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:33.150588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6cf47f67-3e6a-4396-97a7-fdc7f9921ce6 is already attached to instances: a078027c-0fda-486c-9f40-ac527c610a4c Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:33.151975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6cf47f67-3e6a-4396-97a7-fdc7f9921ce6 is already attached to instances: a078027c-0fda-486c-9f40-ac527c610a4c Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 400 to user: Invalid volume: volume 6cf47f67-3e6a-4396-97a7-fdc7f9921ce6 is already attached to instances: a078027c-0fda-486c-9f40-ac527c610a4c {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec7383e4-2dfb-4aff-9cf5-fa444e5562f4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109179 Aug 29 20:17:33.153247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 242/465] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:17:33 2022] POST /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:17:33.159630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:33.160136 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:33.166134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.166618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.167055 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.167780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.168233 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.168653 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.194863 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:17:33.286414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-da823864-e6a2-4264-bba8-bb55cc04cb2e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 204 len: 0 microversion: 2.1 time: 0.130784 Aug 29 20:17:33.287208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 224/466] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:17:33 2022] DELETE /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:33.296893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:33.298091 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:33.305764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.306284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.306722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.307461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:33.307926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:33.308347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:33.447910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:33.456613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67e52766-7b69-424e-870d-239da5d458d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1687 microversion: 2.1 time: 0.164730 Aug 29 20:17:33.457255 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 243/467] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:33 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:34.479553 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:34.480241 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:34.487185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.487667 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.488098 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.488781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:34.489229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:34.489648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:34.619004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:34.626802 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1cde48dd-e92b-426a-8588-aacc0da98241 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1687 microversion: 2.1 time: 0.151501 Aug 29 20:17:34.627409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 225/468] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:34 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:35.647864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:35.648706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:35.656478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:35.657109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:35.657557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:35.658295 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:35.658777 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:35.659224 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:35.808180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:35.817317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71892acf-99fd-494f-a759-a7c9c1986abf tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1687 microversion: 2.1 time: 0.173219 Aug 29 20:17:35.818223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 244/469] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:35 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:36.211267 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-d18b3418-fd64-4072-aaba-cfd04f859808 req-aa2538cb-0586-4896-9e4b-797742d0a334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce8543-4378-4a6f-b1ce-c98e6321ec59", "name": "network-vif-deleted", "tag": "1db8c83e-b525-40c2-96a4-682d0468352c"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:36.223797 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d18b3418-fd64-4072-aaba-cfd04f859808 req-aa2538cb-0586-4896-9e4b-797742d0a334 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:36.224284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d18b3418-fd64-4072-aaba-cfd04f859808 req-aa2538cb-0586-4896-9e4b-797742d0a334 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:36.224715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-d18b3418-fd64-4072-aaba-cfd04f859808 req-aa2538cb-0586-4896-9e4b-797742d0a334 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:36.240920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-d18b3418-fd64-4072-aaba-cfd04f859808 req-aa2538cb-0586-4896-9e4b-797742d0a334 service nova] Creating event network-vif-deleted:1db8c83e-b525-40c2-96a4-682d0468352c for instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 on hv-cinder-85426 Aug 29 20:17:36.247285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-d18b3418-fd64-4072-aaba-cfd04f859808 req-aa2538cb-0586-4896-9e4b-797742d0a334 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040578 Aug 29 20:17:36.247796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 226/470] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:17:36.839397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:36.840017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:36.847026 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:36.847886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:36.848509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:36.849372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:36.850001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:36.850425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:36.883219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:36.883949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:36.884525 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:36.885151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lazy-loading 'fault' on Instance uuid 34ce8543-4378-4a6f-b1ce-c98e6321ec59 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:17:36.933429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:36.942868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8b1489f-4e7b-4460-8373-f165b5c82760 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 200 len: 1336 microversion: 2.1 time: 0.107401 Aug 29 20:17:36.943569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 245/471] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:36 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:37.020052 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef7219b4-780d-4fef-b7de-e28098faf6a7"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:37.024442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:37.033554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.034287 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.035104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.036065 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.036678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.037266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.335334 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e50ad244-0e2c-4c51-af2d-cbd7321c60ac tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319750 Aug 29 20:17:37.336658 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 227/472] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:17:37 2022] POST /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:37.966094 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:37.966797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:37.977324 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.977934 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.978375 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.979147 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:37.979606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:37.980066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:37.996351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 HTTP/1.1 Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:17:37.997904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:17:37.999270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '34ce8543-4378-4a6f-b1ce-c98e6321ec59'} Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:17:38.000123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:17:38.005292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:38.006510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:17:38.006510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eeb93c93-4f19-44cb-ab3e-be348afb3ce5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 404 len: 111 microversion: 2.1 time: 0.038995 Aug 29 20:17:38.006510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 246/473] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:37 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:17:38.009753 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-af2973ac-cee3-4389-9c50-655c63d1f0f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '.version_select at 0x7f4469529790>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:38.032468 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-af2973ac-cee3-4389-9c50-655c63d1f0f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743204863" status: 202 len: 0 microversion: 2.1 time: 0.026928 Aug 29 20:17:38.033164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 228/474] 10.222.0.121 () {58 vars in 1226 bytes} [Mon Aug 29 20:17:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743204863 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:17:38.738873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:38.739387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:38.745431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.745914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.746350 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.747033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:38.747518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:38.747937 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:38.874188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lazy-loading 'services' on Instance uuid a078027c-0fda-486c-9f40-ac527c610a4c {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:17:38.988110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e1e0c32-87e3-4932-bace-798f2e686bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments/6cf47f67-3e6a-4396-97a7-fdc7f9921ce6" status: 202 len: 0 microversion: 2.1 time: 0.252914 Aug 29 20:17:38.988806 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 247/475] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:17:38 2022] DELETE /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments/6cf47f67-3e6a-4396-97a7-fdc7f9921ce6 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:17:38.997498 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:39.000415 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:39.007397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.007881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.008333 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:39.009096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:39.009549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:39.009966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:39.040058 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9f79b265-2f67-494e-a5d8-32d10ea7ad79 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046835 Aug 29 20:17:39.040596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 229/476] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:38 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:40.053004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:40.055327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:40.062482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:40.062971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:40.063437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:40.064178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:40.064623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:40.065041 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:40.098435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26e7a1df-9f89-4e8f-862b-08a16043598b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049701 Aug 29 20:17:40.098993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 248/477] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:40 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:41.109874 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:41.112142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:41.118477 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:41.118943 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:41.119412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:41.120096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:41.120562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:41.120960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:41.150989 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bec58073-15ea-4eb3-9e71-47f0cb79eaf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Aug 29 20:17:41.151584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 230/478] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:41 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:42.164559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:42.166794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:42.173868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.174379 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.174816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.175546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:42.176004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:42.176425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:42.205233 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be3f6c05-ed23-4816-bc6b-7925ea2cc6b0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Aug 29 20:17:42.205791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 249/479] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:42 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:43.216855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:43.219133 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:43.225659 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:43.226144 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:43.226588 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:43.227309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:43.227770 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:43.228196 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:43.258353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f93af562-cca6-4c35-9550-470089c9181b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 Aug 29 20:17:43.258903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 231/480] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:43 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:44.271148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:44.273236 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:44.280029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.281116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.281586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:44.282280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:44.282735 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:44.283202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:44.311619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-adc94a22-8cbe-42fc-82f9-1a059b6f1842 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Aug 29 20:17:44.312168 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 250/481] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:44 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:45.323778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:45.326115 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:45.332995 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:45.333478 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:45.333910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:45.334604 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:45.335057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:45.335500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:45.367378 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3e20ba9e-1cbc-47e4-8e60-3c6692fe3cf2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047476 Aug 29 20:17:45.367943 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 232/482] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:45 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:46.380457 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:46.382632 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:46.389213 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.389700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.390137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.390862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:46.391329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:46.391755 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:46.421816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c72035a0-7110-4900-9ad8-28b9d3d21009 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Aug 29 20:17:46.422371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 251/483] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:46 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:17:47.434021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:47.436205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:47.443217 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.443701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.444136 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.444826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:47.445278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:47.445699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:47.476088 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e3edfda7-93f1-465a-a21a-d71b76d5d66d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045956 Aug 29 20:17:47.476779 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 233/484] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:47 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:48.489211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:48.491363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:48.497702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:48.498184 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:48.498614 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:48.499943 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:48.500475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:48.500908 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:48.529979 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a6eb3965-dd87-4b89-91e9-7ec7f69bdf0e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Aug 29 20:17:48.530567 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 252/485] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:48 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:49.125612 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:49.127842 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:49.133892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.134383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.134822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.135564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.136028 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.136451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.160005 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'flavor' on Instance uuid 89712622-db65-462f-a0eb-356e69bbadb3 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:17:49.284138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-58f0d182-fab6-4925-9945-c2328bce2004 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/action" status: 200 len: 32 microversion: 2.1 time: 0.162253 Aug 29 20:17:49.284641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 234/486] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:17:49 2022] POST /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:17:49.293871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:49.294473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:49.300499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.300979 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.301410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.302095 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.302577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.302997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.447772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:49.456753 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b641414f-cdbf-4260-977a-03af6615bbe8 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.166661 Aug 29 20:17:49.457330 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 253/487] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:49 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:49.543189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:49.545867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:49.552870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.553651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.554250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.555315 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:49.555927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:49.556484 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:49.589366 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-19690cb6-5b44-4ffc-9056-c6123e6ed2f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050692 Aug 29 20:17:49.593848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 235/488] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:49 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:50.478496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:50.479117 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:50.486303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.486793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.487285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.487994 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.488453 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.488881 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.602241 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:50.604729 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:50.612161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.612649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.613076 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.613774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.614232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.614642 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.624636 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:50.632709 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:50.636561 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4142dc6-1762-45e8-96cf-e82d4a7a93cd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.161857 Aug 29 20:17:50.637148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 254/489] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:50 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:50.648411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-726bc154-e5e6-465b-b287-cc159e88b957 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050411 Aug 29 20:17:50.648989 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 236/490] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:17:50 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:17:50.716227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:50.716825 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:50.723607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.724090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.724522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.725218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.725672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.726091 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.757717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:17:50.835034 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd64886c-470c-4cce-aefb-6443399dc4ea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 204 len: 0 microversion: 2.1 time: 0.122153 Aug 29 20:17:50.835926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 255/491] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:17:50 2022] DELETE /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:50.845536 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:50.846432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:50.852701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.853196 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.853634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.854357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:50.854800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:50.855259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:50.992686 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:51.001291 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-aaf3ba4b-a610-460d-8574-1051d59231ae tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1686 microversion: 2.1 time: 0.160481 Aug 29 20:17:51.001877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 237/492] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:50 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:51.658718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:51.659327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:51.665275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:51.665754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:51.666185 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:51.666870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:51.667361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:51.667779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:51.688277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.802528 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:51.810953 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e7d6ec0-01de-41e6-9c3c-616ade075da3 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.157006 Aug 29 20:17:51.811848 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 256/493] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:51 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:52.022024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:52.022628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:52.029444 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:52.029920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:52.030841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.031561 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:52.032013 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:52.032430 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.159730 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:52.167391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-00f0e4b3-1ac1-4920-9688-f07583153e07 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1686 microversion: 2.1 time: 0.149190 Aug 29 20:17:52.167952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 238/494] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:52 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:52.833472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:52.834187 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:52.840707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:52.841195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:52.841633 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.842332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:52.842879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:52.843244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:52.988346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:52.996974 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89e8f97e-faea-41a4-84d9-3cd76eb77919 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.167392 Aug 29 20:17:52.997586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 257/495] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:52 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:53.188952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:53.189696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:53.196173 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.196736 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.197247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.198022 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.198574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.199071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.265685 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:53.273417 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e0fc9895-3057-458c-ba55-9ba2c5a8492d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 200 len: 1618 microversion: 2.1 time: 0.088924 Aug 29 20:17:53.273993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 239/496] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:53 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 1618 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:53.538501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8e8eb4e1-227e-45f3-adcc-a4b8be778d38 req-8014965d-91e1-4c35-b603-9563ab68950c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a078027c-0fda-486c-9f40-ac527c610a4c", "name": "network-vif-deleted", "tag": "42fa43bf-f892-46be-b812-4b6d81b4ea2d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:53.551246 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8e8eb4e1-227e-45f3-adcc-a4b8be778d38 req-8014965d-91e1-4c35-b603-9563ab68950c service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:53.552032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8e8eb4e1-227e-45f3-adcc-a4b8be778d38 req-8014965d-91e1-4c35-b603-9563ab68950c service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:53.552641 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8e8eb4e1-227e-45f3-adcc-a4b8be778d38 req-8014965d-91e1-4c35-b603-9563ab68950c service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:53.566225 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8e8eb4e1-227e-45f3-adcc-a4b8be778d38 req-8014965d-91e1-4c35-b603-9563ab68950c service nova] Creating event network-vif-deleted:42fa43bf-f892-46be-b812-4b6d81b4ea2d for instance a078027c-0fda-486c-9f40-ac527c610a4c on hv-cinder-85426 Aug 29 20:17:53.571100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8e8eb4e1-227e-45f3-adcc-a4b8be778d38 req-8014965d-91e1-4c35-b603-9563ab68950c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036711 Aug 29 20:17:53.571718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 258/497] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:54.019655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:54.020359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:54.026663 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.027549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.031832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.031832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.031832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.031832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.174992 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:54.183434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-403bc8e9-6f21-46ce-9169-df27cdc5d282 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.169251 Aug 29 20:17:54.183995 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 240/498] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:54 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:54.304885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:54.306721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:54.318283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.318872 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.319412 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.320203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:54.320860 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:54.321457 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:54.337325 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c HTTP/1.1 Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:17:54.339143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:17:54.341542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'a078027c-0fda-486c-9f40-ac527c610a4c'} Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:17:54.342895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:17:54.345037 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:17:54.346956 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:17:54.346956 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77fa099e-4a50-44e9-99f9-27bfc33d8cf6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 404 len: 111 microversion: 2.1 time: 0.047343 Aug 29 20:17:54.346956 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 259/499] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:54 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:17:54.353354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4f217edf-66c5-4727-b8ec-44881e482df9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '.version_select at 0x7f446955dd30>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:54.376571 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4f217edf-66c5-4727-b8ec-44881e482df9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780097926" status: 202 len: 0 microversion: 2.1 time: 0.030122 Aug 29 20:17:54.377330 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 241/500] 10.222.0.121 () {58 vars in 1223 bytes} [Mon Aug 29 20:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780097926 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:17:55.036227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67dd98b4-0493-4d6e-8354-31b3c1d81bda tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: .version_select at 0x7f4469580040>, body: {"keypair": {"name": "tempest-keypair-706986606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImk+GOm6we3oSfANZc7gL9IPvHjLrZG1FIs/9zzDB9u/PVS7G5QPPU7hJT8Gl1dAfY529ZEXnnWkgdllSX5R/vCto1vVH1d6XJfn6gv3J2jY3kRJIW7cIOPJTDBU9lt1w=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:55.052680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-67dd98b4-0493-4d6e-8354-31b3c1d81bda tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:17:55.056549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-67dd98b4-0493-4d6e-8354-31b3c1d81bda tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:17:55.080327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67dd98b4-0493-4d6e-8354-31b3c1d81bda tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048031 Aug 29 20:17:55.080917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 260/501] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:17:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:17:55.206401 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:55.207303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:55.218236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:55.218735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:55.219406 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:55.220126 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:55.220597 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:55.221014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:55.371372 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:55.380572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c4e0e94e-043c-4cdf-872e-b9737f87ea8f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.178510 Aug 29 20:17:55.381157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 242/502] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:55 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:56.385456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-387404512", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "190f63a4-9b8c-4268-a1f5-7e230ea6f86c"}], "security_groups": [{"name": "tempest-securitygroup--1996150795"}], "key_name": "tempest-keypair-706986606", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:56.404125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:56.404706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:56.412031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:56.412518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:56.412955 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:56.413649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:56.414132 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:56.414556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:56.554082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] validate_networks() for [('190f63a4-9b8c-4268-a1f5-7e230ea6f86c', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:17:56.635212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:56.643686 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-044f3d17-3b51-4e56-b363-d87bbd7ef7f9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.243883 Aug 29 20:17:56.644301 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 243/503] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:56 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:56.946428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:17:56.946854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:17:56.947399 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:17:56.947828 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:17:56.948243 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:17:56.957853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:56.958332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:56.958768 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:56.959550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:56.960010 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:56.960435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:56.977473 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:17:56.981567 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:17:56.992898 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:17:56.995273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:17:57.044555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d56661d2-b45b-4bb4-a057-22012ea56ce2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.663683 Aug 29 20:17:57.045287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 261/504] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:17:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:17:57.055905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-23ef42f1-7db3-4683-ac5c-27c2445e6d8e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:57.056508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-23ef42f1-7db3-4683-ac5c-27c2445e6d8e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:57.111529 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-23ef42f1-7db3-4683-ac5c-27c2445e6d8e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:57.120863 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-23ef42f1-7db3-4683-ac5c-27c2445e6d8e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1244 microversion: 2.1 time: 0.068800 Aug 29 20:17:57.123654 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 244/505] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:57 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:57.665721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:57.666347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:57.674148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:57.674633 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:57.675062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:57.675780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:57.676234 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:57.676656 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:57.818656 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:57.827446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e2ffc7a-5cf6-444d-be36-970abb403d44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.165967 Aug 29 20:17:57.827965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 262/506] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:57 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:58.143125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:58.144504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:58.151567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:58.152062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:58.152497 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:58.153487 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:58.153957 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:58.154928 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:58.225571 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:58.236381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0fc9a229-8f68-4fec-bbfc-71b551f87a02 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1296 microversion: 2.1 time: 0.097464 Aug 29 20:17:58.236969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 245/507] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:58 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:58.850108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:58.850772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:58.857060 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:58.857543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:58.857970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:58.858702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:58.859280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:58.859701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:58.998469 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:59.007683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1f6f51c-12af-4aa1-9e14-ec237c016051 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.162291 Aug 29 20:17:59.008277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 263/508] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:58 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:59.259159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:17:59.259767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:17:59.275250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:59.276376 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:59.276832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:59.277867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:59.278772 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:59.279214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:59.422421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:17:59.430858 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-75872252-60a5-414e-af1b-4dd937a50e97 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1370 microversion: 2.1 time: 0.176359 Aug 29 20:17:59.431773 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 246/509] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:17:59 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:59.911276 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-03f888e9-acda-430d-8e9e-355cb113215c req-659ad789-838f-4c18-a5cf-bcc3fbb65a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c624a0f-156c-4f96-b9f9-a418c1a47066", "tag": "e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:17:59.921917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-03f888e9-acda-430d-8e9e-355cb113215c req-659ad789-838f-4c18-a5cf-bcc3fbb65a9f service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:17:59.928856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-03f888e9-acda-430d-8e9e-355cb113215c req-659ad789-838f-4c18-a5cf-bcc3fbb65a9f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:17:59.929252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-03f888e9-acda-430d-8e9e-355cb113215c req-659ad789-838f-4c18-a5cf-bcc3fbb65a9f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:17:59.946742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-03f888e9-acda-430d-8e9e-355cb113215c req-659ad789-838f-4c18-a5cf-bcc3fbb65a9f service nova] Creating event network-changed:e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5 for instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 on hv-cinder-85426 Aug 29 20:17:59.953857 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-03f888e9-acda-430d-8e9e-355cb113215c req-659ad789-838f-4c18-a5cf-bcc3fbb65a9f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046085 Aug 29 20:17:59.954774 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 264/510] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:00.029814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:00.030355 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:00.037068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:00.037567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:00.038012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:00.038717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:00.039210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:00.039641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:00.170525 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:00.180265 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-060f74d5-613f-4e2c-ad48-e4e25947515b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.154497 Aug 29 20:18:00.180846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 247/511] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:00 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:00.453526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:00.454324 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:00.460722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:00.461285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:00.461719 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:00.462427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:00.462955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:00.463418 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:00.603629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:00.611613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce632bad-01b3-4368-8cbb-9bebe060e99a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1370 microversion: 2.1 time: 0.163166 Aug 29 20:18:00.612202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 265/512] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:00 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:01.201621 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:01.202210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:01.209092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:01.209580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:01.210016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:01.210750 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:01.211244 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:01.211672 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:01.351785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:01.360900 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0efd5be1-7c30-46f2-997b-84a6346f9743 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.163098 Aug 29 20:18:01.361636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 248/513] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:01 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:01.632787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:01.633507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:01.640868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:01.641479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:01.641987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:01.642784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:01.643357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:01.643858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:01.785276 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:01.793055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea8e7554-f188-4eb2-a58b-759e91f2a76d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1370 microversion: 2.1 time: 0.164199 Aug 29 20:18:01.793647 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 266/514] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:01 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:02.382362 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:02.383177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:02.390230 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:02.390757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:02.392450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:02.392450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:02.392871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:02.394109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:02.527008 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:02.535479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-139d23b9-d6d3-4dd3-b9c1-7aefc9c26d25 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.157137 Aug 29 20:18:02.536031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 249/515] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:02 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:02.814897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:02.815525 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:02.822142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:02.822624 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:02.823405 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:02.824110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:02.824570 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:02.824992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:02.965986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:02.974097 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77d9e172-3a06-429b-9f10-f941205559ad tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1370 microversion: 2.1 time: 0.163560 Aug 29 20:18:02.974677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 267/516] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:02 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:03.556483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:03.557081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:03.559590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:03.565076 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:03.565673 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:03.566109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:03.566798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:03.568188 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:03.568188 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:03.703468 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:03.711749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-58c3b1fc-0784-4d8a-a97d-2e83d91ee846 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.159096 Aug 29 20:18:03.712384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 250/517] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:03 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:03.995697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:03.996238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:03.998607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:04.003962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:04.004452 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:04.004881 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:04.005577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:04.006033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:04.006484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:04.138574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:04.146823 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa9534b3-5d89-4455-ae3d-773cf8fb2ea1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1370 microversion: 2.1 time: 0.155144 Aug 29 20:18:04.147401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 268/518] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:03 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:04.733354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:04.734356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:04.741057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:04.741057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:04.741272 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:04.741947 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:04.742430 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:04.742847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:04.882077 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:04.892715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-55db5ebf-ca27-4cc2-b6d3-939bead9b117 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.163218 Aug 29 20:18:04.893347 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 251/519] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:04 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:05.013018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ab2c7dc9-dd12-484b-be4b-bbb962c9d9d2 req-b0fb7e09-fc7e-407b-8ed6-0c5695441ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c624a0f-156c-4f96-b9f9-a418c1a47066", "name": "network-vif-plugged", "status": "completed", "tag": "e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:05.023113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab2c7dc9-dd12-484b-be4b-bbb962c9d9d2 req-b0fb7e09-fc7e-407b-8ed6-0c5695441ab8 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.023638 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab2c7dc9-dd12-484b-be4b-bbb962c9d9d2 req-b0fb7e09-fc7e-407b-8ed6-0c5695441ab8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.024137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ab2c7dc9-dd12-484b-be4b-bbb962c9d9d2 req-b0fb7e09-fc7e-407b-8ed6-0c5695441ab8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.036613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ab2c7dc9-dd12-484b-be4b-bbb962c9d9d2 req-b0fb7e09-fc7e-407b-8ed6-0c5695441ab8 service nova] Creating event network-vif-plugged:e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5 for instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 on hv-cinder-85426 Aug 29 20:18:05.041559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ab2c7dc9-dd12-484b-be4b-bbb962c9d9d2 req-b0fb7e09-fc7e-407b-8ed6-0c5695441ab8 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032343 Aug 29 20:18:05.042280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 269/520] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:05.169099 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:05.169602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:05.176247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.176733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.177160 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.177852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.178305 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.178723 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.306247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:05.307019 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:05.310931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:05.314158 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.314650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.315182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.315883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.316337 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.316767 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.320258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c1e6545e-5554-4b45-9b17-a8f4ce0986b1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1370 microversion: 2.1 time: 0.155614 Aug 29 20:18:05.321206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 252/521] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:05 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:05.346965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0aea8ca-5c2c-4b2b-bda9-10f69a303d57 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments/3972c325-ab25-4688-88a2-12b348ffbd49" status: 200 len: 194 microversion: 2.20 time: 0.045489 Aug 29 20:18:05.347585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 270/522] 10.222.0.121 () {60 vars in 1459 bytes} [Mon Aug 29 20:18:05 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments/3972c325-ab25-4688-88a2-12b348ffbd49 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:18:05.417016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:05.417504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:05.424070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.424572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.424993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.425683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.426139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.426563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.564819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lazy-loading 'services' on Instance uuid 2ee34ea9-ae27-4156-8f42-17d06286bebe {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:05.679847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-09bcc2ce-b681-4fcc-a34b-d4f036e53e43 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments/3972c325-ab25-4688-88a2-12b348ffbd49" status: 202 len: 0 microversion: 2.20 time: 0.266485 Aug 29 20:18:05.680546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 253/523] 10.222.0.121 () {60 vars in 1462 bytes} [Mon Aug 29 20:18:05 2022] DELETE /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments/3972c325-ab25-4688-88a2-12b348ffbd49 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:05.689586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:05.691758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:05.699916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.700497 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.700996 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.701733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.702184 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.702606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.732922 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b0fbe55-41ea-431c-897b-c49179aa8484 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047664 Aug 29 20:18:05.734278 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 271/524] 10.222.0.121 () {60 vars in 1348 bytes} [Mon Aug 29 20:18:05 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:05.916312 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:05.917035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:05.925258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.925757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.926192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.926887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:05.927504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:05.927991 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:05.948376 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.068432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:06.077749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e14936f2-49ef-4aca-9938-00d27ba087a0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.166498 Aug 29 20:18:06.078306 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 254/525] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:05 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:06.344001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:06.344603 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:06.351164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:06.351571 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:06.352007 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:06.352692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:06.353144 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:06.353665 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:06.493079 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:06.501620 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d20e11a-5beb-4cfd-9e90-6e96527f4476 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1370 microversion: 2.1 time: 0.161966 Aug 29 20:18:06.502211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 272/526] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:06 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:06.746446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:06.748776 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:06.755437 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:06.755933 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:06.756375 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:06.757078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:06.757539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:06.757969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:06.788921 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2bc387fb-c536-4895-b3c4-067832eb61ca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046415 Aug 29 20:18:06.789492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 255/527] 10.222.0.121 () {60 vars in 1348 bytes} [Mon Aug 29 20:18:06 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:07.098164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:07.099006 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:07.102129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.102896 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.107752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.108783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.109220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.109919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.110378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.110801 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.241900 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:07.250040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9535622e-ac4e-443b-a301-3ea5b03cdab9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.155567 Aug 29 20:18:07.250672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 273/528] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:07 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:07.522701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:07.523879 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:07.526204 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.532241 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.532730 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.533166 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.533862 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.534319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.534744 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.674538 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:07.683970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-50477ab1-8419-4b43-8086-12fd31b72e47 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1561 microversion: 2.1 time: 0.163588 Aug 29 20:18:07.683970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 256/529] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:07 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:07.703045 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:07.703608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:07.710368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.710852 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.711336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.712040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.712491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.712912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.792764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b728e898-6003-4541-a601-1b4f824751d3 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094153 Aug 29 20:18:07.793355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 274/530] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:18:07 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:07.801825 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:07.804144 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:07.810590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.811103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.811554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.812260 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.812718 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.813336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.849350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7d31ad32-aaad-4a9f-b01a-cd596f6835f9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050853 Aug 29 20:18:07.854255 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 257/531] 10.222.0.121 () {60 vars in 1348 bytes} [Mon Aug 29 20:18:07 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:07.916507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:07.916997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:07.923295 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.923787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.924219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.924929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:07.925390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:07.925813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:07.951912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:18:08.044790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1c765ec-2d4f-4d80-9c7f-016e5c0a0848 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 204 len: 0 microversion: 2.20 time: 0.131891 Aug 29 20:18:08.045289 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 275/532] 10.222.0.121 () {60 vars in 1285 bytes} [Mon Aug 29 20:18:07 2022] DELETE /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:18:08.054830 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:08.055560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:08.062373 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:08.062872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:08.063349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:08.064072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:08.064532 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:08.064964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:08.272666 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:08.273360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:08.279830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:08.280322 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:08.280756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:08.281463 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:08.282003 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:08.282424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:08.286867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:08.538344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:08.548461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:08.549912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:08.551284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3c94ba7a-f1e3-4e45-ad0c-9cd7002cc001 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.500270 Aug 29 20:18:08.551892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 258/533] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:08 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:18:08.610262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:08.618681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50550510-b05b-4968-9cbc-0b654191e883 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.350174 Aug 29 20:18:08.619396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 276/534] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:08 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:09.134528 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-a482af4e-3cff-4430-8e93-2323d46f6095 req-cf7659a6-9b5c-4abd-bbe6-b1f131880c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c624a0f-156c-4f96-b9f9-a418c1a47066", "tag": "e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:09.144280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a482af4e-3cff-4430-8e93-2323d46f6095 req-cf7659a6-9b5c-4abd-bbe6-b1f131880c27 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:09.144683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a482af4e-3cff-4430-8e93-2323d46f6095 req-cf7659a6-9b5c-4abd-bbe6-b1f131880c27 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:09.145114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a482af4e-3cff-4430-8e93-2323d46f6095 req-cf7659a6-9b5c-4abd-bbe6-b1f131880c27 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:09.157090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-a482af4e-3cff-4430-8e93-2323d46f6095 req-cf7659a6-9b5c-4abd-bbe6-b1f131880c27 service nova] Creating event network-changed:e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5 for instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 on hv-cinder-85426 Aug 29 20:18:09.161983 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-a482af4e-3cff-4430-8e93-2323d46f6095 req-cf7659a6-9b5c-4abd-bbe6-b1f131880c27 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031245 Aug 29 20:18:09.162572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 259/535] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:09.575953 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:09.579751 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:09.588419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:09.589269 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:09.589936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:09.590883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:09.591569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:09.592205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:09.643411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:09.644865 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:09.651708 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:09.652809 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:09.653489 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:09.654453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:09.655207 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:09.655882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:09.782407 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:09.794514 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:09.796421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:09.798003 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-580026c5-5462-4d28-83f3-49fcaa406f6c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1727 microversion: 2.20 time: 0.226187 Aug 29 20:18:09.811617 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 277/536] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:09 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:09.837722 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:09.849704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7b78659a-b3a3-4c8e-8cca-03eb4d972160 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.212376 Aug 29 20:18:09.850916 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 260/537] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:09 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:10.817855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5c7d13d0-db17-4cee-95d4-cb2f2596a13a req-190bea5e-8957-4aff-a4e8-443272b743c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee34ea9-ae27-4156-8f42-17d06286bebe", "name": "network-vif-deleted", "tag": "a973a1f7-934c-4d30-ac16-cec9f03a8bfe"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:10.822101 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:10.822826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:10.827771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c7d13d0-db17-4cee-95d4-cb2f2596a13a req-190bea5e-8957-4aff-a4e8-443272b743c6 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:10.828259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c7d13d0-db17-4cee-95d4-cb2f2596a13a req-190bea5e-8957-4aff-a4e8-443272b743c6 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:10.828689 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5c7d13d0-db17-4cee-95d4-cb2f2596a13a req-190bea5e-8957-4aff-a4e8-443272b743c6 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:10.829508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:10.830284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:10.830854 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:10.831684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:10.832242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:10.834266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:10.840703 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5c7d13d0-db17-4cee-95d4-cb2f2596a13a req-190bea5e-8957-4aff-a4e8-443272b743c6 service nova] Creating event network-vif-deleted:a973a1f7-934c-4d30-ac16-cec9f03a8bfe for instance 2ee34ea9-ae27-4156-8f42-17d06286bebe on hv-cinder-85426 Aug 29 20:18:10.850446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5c7d13d0-db17-4cee-95d4-cb2f2596a13a req-190bea5e-8957-4aff-a4e8-443272b743c6 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Aug 29 20:18:10.851049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 278/538] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:10.877689 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:10.879218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:10.888384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:10.888887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:10.889501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:10.893758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:10.894061 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:10.894911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:10.942388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:10.952919 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:10.954427 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:10.955827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c2869958-78cd-4537-9a2a-d81b5ccdd4f0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1659 microversion: 2.20 time: 0.138042 Aug 29 20:18:10.956859 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 261/539] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:10 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1659 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:18:11.072972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:11.081907 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41b28238-f02a-435b-9dc5-eebad48b19ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.213330 Aug 29 20:18:11.082647 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 279/540] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:10 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:11.980276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:11.980900 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:11.988953 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:11.989431 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:11.989863 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:11.990546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:11.990994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:11.991441 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.022406 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:12.022866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:12.023330 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.023768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lazy-loading 'fault' on Instance uuid 2ee34ea9-ae27-4156-8f42-17d06286bebe {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:12.067353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:12.075551 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:12.077513 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:12.078652 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-99512637-2bac-4f91-a039-93ceb44032d7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 200 len: 1375 microversion: 2.20 time: 0.102230 Aug 29 20:18:12.079232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 262/541] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:11 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 1375 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:12.102663 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:12.103314 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:12.109743 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:12.110226 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:12.110662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.111382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:12.111842 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:12.112264 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:12.248035 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:12.256387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14e5185f-90b2-491a-a691-7a218bea1076 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1738 microversion: 2.1 time: 0.157438 Aug 29 20:18:12.256960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 280/542] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:12 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:13.101727 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:13.102327 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:13.109769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.110293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.110761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.111503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.111977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.112388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.126161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] HTTP exception thrown: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Request method failure captured: Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe HTTP/1.1 Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR32-e9MNLhZ1oDUqDcicgHfw1nbkGVqg7ViGKYn8x8reV7cAZyq_qLlzjNSpUO2wfbVDf1ztF93bXokAM_HwX170_e7tgk6npx0oOjgbTTwOn4z114py_T0HCYbChdC8rpdpXsMp7LmLTS6VvJEj1CZeVGWdgTDUxfTsaUO0wCLgTU Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:18:13.127869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7f8f374198d34097b4deee456a3b3be7", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}] Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 7ce1e14c83aa47c184750585f941ecb0 Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:18:13.129502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '2ee34ea9-ae27-4156-8f42-17d06286bebe'} Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:18:13.130248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:18:13.131864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.132910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Returning 404 to user: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:18:13.132910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fb03e4d0-d07a-4937-838d-e6cd08cf7772 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 404 len: 111 microversion: 2.20 time: 0.031453 Aug 29 20:18:13.132910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 263/543] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:13 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:18:13.138685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e78880aa-f2b7-4a8c-91fe-15ebb9c4c038 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '.version_select at 0x7f44694f4b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:13.159183 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e78880aa-f2b7-4a8c-91fe-15ebb9c4c038 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104690771" status: 204 len: 0 microversion: 2.20 time: 0.024616 Aug 29 20:18:13.159761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 281/544] 10.222.0.121 () {60 vars in 1267 bytes} [Mon Aug 29 20:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104690771 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:18:13.277908 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:13.278605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:13.285419 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.285904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.286345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.287072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.287568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.288041 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.549562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:13.557743 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a4b161d2-09e2-477d-9e4a-6962edff5701 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1718 microversion: 2.1 time: 0.283865 Aug 29 20:18:13.558311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 264/545] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:13 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1718 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:13.667955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:13.668592 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:13.678033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.678561 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.678993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.679901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.680360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.680788 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.765627 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] HTTP exception thrown: Cannot 'detach_volume' instance 89712622-db65-462f-a0eb-356e69bbadb3 while it is in vm_state rescued Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Request method failure captured: Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments/ef7219b4-780d-4fef-b7de-e28098faf6a7 HTTP/1.1 Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR3-Cs8s_ULLOsdfgfc5xj3VhVd6z9RFUxXBqIwc9ZHVvI7-RhGZMkEFM-bcV4zf9lWw5NFP1E_1eH7sNNtouuLUBpyU6Qe8qwt_QE8WcJ6oe_ICBeRcRy_CUHp4qTV4NWCaMW7GAD_FqOnxLPhxSUFc7L9Vobg8cMSwBwbBL1mmGSY Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:18:13.767363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_eaabbc4be9754bcda6adc796a0340c49", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}] Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 58bf9cf55cfc45d3841366f601abe4f8 Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:18:13.768869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Cannot 'detach_volume' instance 89712622-db65-462f-a0eb-356e69bbadb3 while it is in vm_state rescued Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'server_id': '89712622-db65-462f-a0eb-356e69bbadb3', 'id': 'ef7219b4-780d-4fef-b7de-e28098faf6a7'} Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89712622-db65-462f-a0eb-356e69bbadb3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:18:13.769658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 89712622-db65-462f-a0eb-356e69bbadb3 while it is in vm_state rescued Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 89712622-db65-462f-a0eb-356e69bbadb3 while it is in vm_state rescued Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:13.771055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Returning 409 to user: Cannot 'detach_volume' instance 89712622-db65-462f-a0eb-356e69bbadb3 while it is in vm_state rescued {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:18:13.772247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80d570ea-0e45-42e6-87b3-1d9b88d1fe36 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "DELETE /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments/ef7219b4-780d-4fef-b7de-e28098faf6a7" status: 409 len: 152 microversion: 2.1 time: 0.105522 Aug 29 20:18:13.772726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 282/546] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:18:13 2022] DELETE /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments/ef7219b4-780d-4fef-b7de-e28098faf6a7 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:18:13.778732 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:13.779308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:13.785631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.786143 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.786578 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.787363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.787816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.788235 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.849500 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c846ef75-1df2-4b7c-bca8-8fcb1579320e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'create', calling method: .version_select at 0x7f4469406700>, body: {"keypair": {"name": "tempest-keypair-537243794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSdaM8KKwSudHQ2KNb/b5o3VDUNDC3V5Pcp0h22/riMZn9v6CJpGV4LrKIakGbo9WNWpZy6FebuRusGqcwUmBUptSn7aZ0sa9p66yUoAymvu1ri8Lf3hDtjCibVAJb/wA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:13.862345 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-098b1da4-5f21-4d69-a06d-f6bf866cd70c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "POST /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/action" status: 202 len: 0 microversion: 2.1 time: 0.087476 Aug 29 20:18:13.863128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 265/547] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:18:13 2022] POST /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:18:13.866690 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-c846ef75-1df2-4b7c-bca8-8fcb1579320e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for project 7f8f374198d34097b4deee456a3b3be7. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:13.870738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-c846ef75-1df2-4b7c-bca8-8fcb1579320e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for user 7ce1e14c83aa47c184750585f941ecb0 and project 7f8f374198d34097b4deee456a3b3be7. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:13.872233 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:13.873197 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:13.880105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.880493 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.880999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.882327 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:13.882905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:13.883908 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:13.897784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c846ef75-1df2-4b7c-bca8-8fcb1579320e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052470 Aug 29 20:18:13.898621 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 283/548] 10.222.0.121 () {62 vars in 1205 bytes} [Mon Aug 29 20:18:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:14.034128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:14.045891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-09ed53f3-4efb-40a3-aada-aa05cb85bce4 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1726 microversion: 2.1 time: 0.178031 Aug 29 20:18:14.046504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 266/549] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:13 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:15.067578 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:15.068108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:15.077342 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:15.077833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:15.078260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:15.078965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:15.079455 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:15.079998 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:15.236373 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:15.244613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d84c4ac-6b8a-418a-8b86-2f667ce9e38c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1726 microversion: 2.1 time: 0.181542 Aug 29 20:18:15.245401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 284/550] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:15 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:15.260654 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1079110224", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cda60e18-c78a-4bea-8422-1302e74d6cc6"}], "security_groups": [{"name": "tempest-securitygroup--1437732687"}], "key_name": "tempest-keypair-537243794", "user_data": "}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:15.364257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] validate_networks() for [('cda60e18-c78a-4bea-8422-1302e74d6cc6', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:18:15.909939 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:18:15.910420 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:18:15.910939 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:18:15.911424 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:18:15.911901 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:18:15.921491 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:15.922038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:15.922514 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:15.923350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:15.923844 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:15.924316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:15.940911 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for project 7f8f374198d34097b4deee456a3b3be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:15.944885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Getting quotas for user 7ce1e14c83aa47c184750585f941ecb0 and project 7f8f374198d34097b4deee456a3b3be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:15.955967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:18:15.958248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:18:16.005337 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-65d6e70a-2d26-401d-be96-25877fd7f739 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.749102 Aug 29 20:18:16.006232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 267/551] 10.222.0.121 () {62 vars in 1193 bytes} [Mon Aug 29 20:18:15 2022] POST /compute/v2.1/servers => generated 404 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 20:18:16.017502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f694a96-5094-4a9d-bdee-70cdfd804542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:16.019021 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f694a96-5094-4a9d-bdee-70cdfd804542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:16.077555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f694a96-5094-4a9d-bdee-70cdfd804542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:16.085862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f694a96-5094-4a9d-bdee-70cdfd804542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:16.087350 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f694a96-5094-4a9d-bdee-70cdfd804542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:16.088620 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f694a96-5094-4a9d-bdee-70cdfd804542 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1285 microversion: 2.20 time: 0.075555 Aug 29 20:18:16.089397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 285/552] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:16 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1285 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:18:16.266457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:16.267286 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:16.275583 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:16.276078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:16.276597 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:16.277534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:16.277991 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:16.278598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:16.415924 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:16.424636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fa268551-00d4-42ca-bc48-a01db936f06a tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1726 microversion: 2.1 time: 0.162628 Aug 29 20:18:16.425203 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 268/553] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:16 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:17.110912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:17.111482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:17.118658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.119179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.119622 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.120319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.120782 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.121209 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.182681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:17.191424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:17.192864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:17.193973 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d51cbdb-73b6-424c-a0f2-f36a5547af2b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1337 microversion: 2.20 time: 0.087579 Aug 29 20:18:17.194520 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 286/554] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:17 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:17.445662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:17.446403 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:17.452983 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.453469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.453903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.454596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.455065 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.455525 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.590855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:17.599730 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3c5d0ecb-ccc0-44d6-9cfe-86ff48e36682 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1732 microversion: 2.1 time: 0.157879 Aug 29 20:18:17.600495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 269/555] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:17 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:17.621331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:17.621822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:17.627997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.628421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.628858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.629750 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:17.630208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:17.630649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:17.708329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ff4e3b9-25ec-4277-ae90-9986d45a8a1d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090918 Aug 29 20:18:17.708935 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 287/556] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:18:17 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:18.217849 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:18.218760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:18.226820 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.227720 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.228465 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.229522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.230462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.231151 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.457332 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:18.466209 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:18.467689 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:18.468977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-aea0388f-50f1-484f-9cf5-2c629fabde0a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.255709 Aug 29 20:18:18.469735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 270/557] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:18 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:18.717542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6560e46b-9f21-46d3-9136-856df41bded7 req-0ad14b88-1fc6-4ce6-8220-b822de83de9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89712622-db65-462f-a0eb-356e69bbadb3", "tag": "3bbced07-f74b-4bb6-92a2-a4de1b3dba60"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:18.744987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6560e46b-9f21-46d3-9136-856df41bded7 req-0ad14b88-1fc6-4ce6-8220-b822de83de9e service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:18.745488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6560e46b-9f21-46d3-9136-856df41bded7 req-0ad14b88-1fc6-4ce6-8220-b822de83de9e service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:18.745933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6560e46b-9f21-46d3-9136-856df41bded7 req-0ad14b88-1fc6-4ce6-8220-b822de83de9e service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:18.758835 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6560e46b-9f21-46d3-9136-856df41bded7 req-0ad14b88-1fc6-4ce6-8220-b822de83de9e service nova] Creating event network-changed:3bbced07-f74b-4bb6-92a2-a4de1b3dba60 for instance 89712622-db65-462f-a0eb-356e69bbadb3 on hv-cinder-85426 Aug 29 20:18:18.764438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6560e46b-9f21-46d3-9136-856df41bded7 req-0ad14b88-1fc6-4ce6-8220-b822de83de9e service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051671 Aug 29 20:18:18.765372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 288/558] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:19.110066 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-821d704c-8c2b-4082-85dd-ff883f169b1e req-2c7a9c9d-6dc2-41f7-aad3-a493a58b784f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2853ad5d-1f93-4b5b-841b-b663e207546e", "tag": "96280255-143e-4c45-b633-a728e35130d4"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:19.121144 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-821d704c-8c2b-4082-85dd-ff883f169b1e req-2c7a9c9d-6dc2-41f7-aad3-a493a58b784f service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:19.122090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-821d704c-8c2b-4082-85dd-ff883f169b1e req-2c7a9c9d-6dc2-41f7-aad3-a493a58b784f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:19.122778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-821d704c-8c2b-4082-85dd-ff883f169b1e req-2c7a9c9d-6dc2-41f7-aad3-a493a58b784f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:19.137899 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-821d704c-8c2b-4082-85dd-ff883f169b1e req-2c7a9c9d-6dc2-41f7-aad3-a493a58b784f service nova] Creating event network-changed:96280255-143e-4c45-b633-a728e35130d4 for instance 2853ad5d-1f93-4b5b-841b-b663e207546e on hv-cinder-85426 Aug 29 20:18:19.144781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-821d704c-8c2b-4082-85dd-ff883f169b1e req-2c7a9c9d-6dc2-41f7-aad3-a493a58b784f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042295 Aug 29 20:18:19.145857 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 271/559] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:19.494104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:19.494785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:19.501330 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:19.501807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:19.502293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:19.502926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:19.503522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:19.504105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:19.647794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:19.657537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:19.659493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:19.660824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d7b4556-c4ec-4584-b637-46ed9c4bb54d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.171287 Aug 29 20:18:19.661549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 289/560] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:19 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:20.683728 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:20.684332 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:20.690867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:20.691376 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:20.691806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:20.692496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:20.692947 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:20.693385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:20.711746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:20.788916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d97ba8cb-f674-4ce9-a46c-67b4f84fb199 req-9dc84981-e6ae-46b2-8ef0-5d6c6eb72420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89712622-db65-462f-a0eb-356e69bbadb3", "tag": "3bbced07-f74b-4bb6-92a2-a4de1b3dba60"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:20.798564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d97ba8cb-f674-4ce9-a46c-67b4f84fb199 req-9dc84981-e6ae-46b2-8ef0-5d6c6eb72420 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:20.799212 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d97ba8cb-f674-4ce9-a46c-67b4f84fb199 req-9dc84981-e6ae-46b2-8ef0-5d6c6eb72420 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:20.799827 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d97ba8cb-f674-4ce9-a46c-67b4f84fb199 req-9dc84981-e6ae-46b2-8ef0-5d6c6eb72420 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:20.811669 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d97ba8cb-f674-4ce9-a46c-67b4f84fb199 req-9dc84981-e6ae-46b2-8ef0-5d6c6eb72420 service nova] Creating event network-changed:3bbced07-f74b-4bb6-92a2-a4de1b3dba60 for instance 89712622-db65-462f-a0eb-356e69bbadb3 on hv-cinder-85426 Aug 29 20:18:20.816549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d97ba8cb-f674-4ce9-a46c-67b4f84fb199 req-9dc84981-e6ae-46b2-8ef0-5d6c6eb72420 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033659 Aug 29 20:18:20.817143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 290/561] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:20.836284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:20.848558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:20.850107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:20.851271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b0799a2c-9e18-4ad1-b052-4b2edbc174df tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.171852 Aug 29 20:18:20.851828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 272/562] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:20 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:21.874452 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:21.875114 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:21.881418 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:21.881917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:21.882355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:21.883055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:21.883632 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:21.884067 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:22.014696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:22.023390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:22.024307 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:22.025413 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33ac49cf-4c23-4a90-8e4e-aca64e6f2c1e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.156308 Aug 29 20:18:22.025972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 291/563] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:21 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:23.048201 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:23.048804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:23.055238 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:23.055725 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:23.056154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:23.056844 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:23.057293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:23.057714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:23.188195 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:23.196424 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:23.197896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:23.198996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a4c06fb6-234b-4c69-8b91-2afcccea8950 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.155385 Aug 29 20:18:23.199571 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 273/564] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:23 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:24.221920 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:24.222518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:24.228936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:24.229408 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:24.229836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:24.230515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:24.230966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:24.231424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:24.363640 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:24.371756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:24.373221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:24.374389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8ae5bd6-d8a0-4cb9-89ea-8a1aa33c44e9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.156417 Aug 29 20:18:24.374949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 292/565] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:24 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:25.057727 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-34b4f326-9131-466a-95fc-8195ef4eb7bb req-44311a48-a480-4bab-840a-68c05bf4802d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2853ad5d-1f93-4b5b-841b-b663e207546e", "name": "network-vif-plugged", "status": "completed", "tag": "96280255-143e-4c45-b633-a728e35130d4"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:25.069391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-34b4f326-9131-466a-95fc-8195ef4eb7bb req-44311a48-a480-4bab-840a-68c05bf4802d service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:25.069881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-34b4f326-9131-466a-95fc-8195ef4eb7bb req-44311a48-a480-4bab-840a-68c05bf4802d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:25.070395 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-34b4f326-9131-466a-95fc-8195ef4eb7bb req-44311a48-a480-4bab-840a-68c05bf4802d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:25.082292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-34b4f326-9131-466a-95fc-8195ef4eb7bb req-44311a48-a480-4bab-840a-68c05bf4802d service nova] Creating event network-vif-plugged:96280255-143e-4c45-b633-a728e35130d4 for instance 2853ad5d-1f93-4b5b-841b-b663e207546e on hv-cinder-85426 Aug 29 20:18:25.087392 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-34b4f326-9131-466a-95fc-8195ef4eb7bb req-44311a48-a480-4bab-840a-68c05bf4802d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Aug 29 20:18:25.088394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 274/566] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:25.397463 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:25.398048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:25.405059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:25.405549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:25.405975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:25.406672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:25.407142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:25.407562 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:25.535598 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:25.543594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:25.545588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:25.546677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f9723bb-a4d9-491f-8bb6-fb5684739d09 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.153385 Aug 29 20:18:25.547295 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 293/567] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:25 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:26.566610 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.567437 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.572070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:26.572750 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:26.580310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:26.580786 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:26.581216 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:26.581896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:26.582346 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:26.582768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:26.714337 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:26.722600 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:26.724069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:26.725156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0d6afe01-98e1-4c08-b9e3-e650025ffaf4 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1411 microversion: 2.20 time: 0.159495 Aug 29 20:18:26.725717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 275/568] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:26 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:27.748581 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:27.749194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:27.751250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:27.757207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.757715 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.758154 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:27.758856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.759412 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.759840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:27.899340 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:27.907650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:27.909100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:27.910228 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1cafba60-58bb-4c82-bcf9-08355db3c5a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1602 microversion: 2.20 time: 0.165560 Aug 29 20:18:27.910791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 294/569] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:18:27 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:18:27.932006 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:27.932523 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:27.939483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.939963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.940391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:27.941077 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:27.941642 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:27.942068 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:28.018369 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-989b16e8-c433-448f-a166-077514433191 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090266 Aug 29 20:18:28.018970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 276/570] 10.222.0.121 () {60 vars in 1321 bytes} [Mon Aug 29 20:18:27 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:29.115671 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-84a58cbc-5af4-409a-af76-4fa57748cca2 req-eafa21a3-d0b9-49d2-b75b-147bd53107d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2853ad5d-1f93-4b5b-841b-b663e207546e", "tag": "96280255-143e-4c45-b633-a728e35130d4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:29.126360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-84a58cbc-5af4-409a-af76-4fa57748cca2 req-eafa21a3-d0b9-49d2-b75b-147bd53107d1 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:29.126833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-84a58cbc-5af4-409a-af76-4fa57748cca2 req-eafa21a3-d0b9-49d2-b75b-147bd53107d1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:29.127281 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-84a58cbc-5af4-409a-af76-4fa57748cca2 req-eafa21a3-d0b9-49d2-b75b-147bd53107d1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:29.137937 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-84a58cbc-5af4-409a-af76-4fa57748cca2 req-eafa21a3-d0b9-49d2-b75b-147bd53107d1 service nova] Creating event network-changed:96280255-143e-4c45-b633-a728e35130d4 for instance 2853ad5d-1f93-4b5b-841b-b663e207546e on hv-cinder-85426 Aug 29 20:18:29.142743 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-84a58cbc-5af4-409a-af76-4fa57748cca2 req-eafa21a3-d0b9-49d2-b75b-147bd53107d1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030708 Aug 29 20:18:29.143330 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 295/571] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:52.714309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:52.715141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=20 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:52.832168 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:52.832658 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:52.838425 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.838901 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.839360 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.840045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.840495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.840919 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.864873 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b7883c5b-a027-4b5d-8d84-fec38b7024dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/ips" status: 200 len: 151 microversion: 2.1 time: 0.152177 Aug 29 20:18:52.865428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 277/572] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:18:52 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/ips => generated 151 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:52.975897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:52.976577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=82 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:52.981373 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:52.981955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:52.990247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.990781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.991251 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:52.992025 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:52.992649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:52.993068 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:53.024400 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:18:53.114669 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-458e95b8-bccf-4646-b3d9-d9ba6f863e95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "DELETE /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 204 len: 0 microversion: 2.1 time: 0.139181 Aug 29 20:18:53.115256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 296/573] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:18:52 2022] DELETE /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:53.124934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:53.125493 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:53.133472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:53.134256 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:53.134723 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:53.135416 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:53.135892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:53.136315 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:53.376933 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:53.384936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bcafdb5b-9c14-4c54-aad1-bc76183ca08a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1579 microversion: 2.1 time: 0.265057 Aug 29 20:18:53.385522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 278/574] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:53 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1579 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:54.218343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "126a17bd-2115-40d5-92bd-bd1dffedc98c"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:54.221447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:54.228195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.228675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.229099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.229785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.230230 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.230645 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.405796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:54.406394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:54.413568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.413976 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.414405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.415105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:54.415623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:54.416042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:54.548762 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:54.556453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a67dab4a-fa60-4db5-8361-757567104b7a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1579 microversion: 2.1 time: 0.154422 Aug 29 20:18:54.557021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 279/575] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:54 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:54.740846 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b453509a-46d2-4e62-89b6-fe806691297b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526455 Aug 29 20:18:54.741527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 297/576] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:18:54 2022] POST /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:55.577935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:55.578540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:55.586364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:55.586849 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:55.587310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:55.588016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:55.588483 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:55.588903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:55.722956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:55.730980 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-127b0597-4b4e-43af-8328-a4922a495a6f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1579 microversion: 2.1 time: 0.156911 Aug 29 20:18:55.731646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 280/577] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:55 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:56.150667 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-95608719-8c72-49ff-9a50-45d7f084d919 req-a4d0ba16-fc62-450c-beeb-7004197b54e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af99cf2b-b549-400f-bad3-1bf633c6a2c4", "name": "network-vif-deleted", "tag": "560f6043-4fba-46ff-bc9d-77f769ad7a55"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:56.161734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-95608719-8c72-49ff-9a50-45d7f084d919 req-a4d0ba16-fc62-450c-beeb-7004197b54e2 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.162216 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-95608719-8c72-49ff-9a50-45d7f084d919 req-a4d0ba16-fc62-450c-beeb-7004197b54e2 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.162648 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-95608719-8c72-49ff-9a50-45d7f084d919 req-a4d0ba16-fc62-450c-beeb-7004197b54e2 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.174120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-95608719-8c72-49ff-9a50-45d7f084d919 req-a4d0ba16-fc62-450c-beeb-7004197b54e2 service nova] Creating event network-vif-deleted:560f6043-4fba-46ff-bc9d-77f769ad7a55 for instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 on hv-cinder-85426 Aug 29 20:18:56.179100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-95608719-8c72-49ff-9a50-45d7f084d919 req-a4d0ba16-fc62-450c-beeb-7004197b54e2 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036243 Aug 29 20:18:56.179803 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 298/578] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:56.658663 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:56.659181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:56.666306 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.666790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.667247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.667941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.668391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.668813 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.756411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:56.757333 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:56.758122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'services' on Instance uuid 89712622-db65-462f-a0eb-356e69bbadb3 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:56.764077 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.764574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.765014 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.765720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.766188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.766653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.799675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.800158 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.800596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.801044 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lazy-loading 'fault' on Instance uuid af99cf2b-b549-400f-bad3-1bf633c6a2c4 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:18:56.847349 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:56.849297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e2bfb692-4adc-4f66-aea1-e64770ce3df9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "DELETE /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments/ef7219b4-780d-4fef-b7de-e28098faf6a7" status: 202 len: 0 microversion: 2.1 time: 0.194810 Aug 29 20:18:56.850006 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 281/579] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:18:56 2022] DELETE /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments/ef7219b4-780d-4fef-b7de-e28098faf6a7 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:18:56.857383 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22ffe028-6b45-4c4f-8e7a-699978e4d81c tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 200 len: 1232 microversion: 2.1 time: 0.107272 Aug 29 20:18:56.857953 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 299/580] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:56 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 1232 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:56.860057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:56.863583 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:56.870545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.871067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.871520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.872222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:56.872677 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:56.873700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:56.909198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8dbd8aad-9804-444c-b473-7d7fe59ffe54 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054034 Aug 29 20:18:56.909781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 282/581] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:18:56 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:57.882587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:57.883228 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:57.889709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.890192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.890623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.891343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.892474 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.892893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.906254 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] HTTP exception thrown: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Request method failure captured: Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 HTTP/1.1 Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR5YgW2cmFa4Iet_8Z0UZR6G6fVnx_1aT6R_5OK1bDl31lceZ1waDTgzL-Yc6vobv0CKAx4BvDbdhIMLVfTiBonU6SoeXTMEZv5NXRaAk5CucfEGQWpEP8PSDCxJ87xkUcuNMi1xw6lMSfLn2v7BXX5QF2cJPfDdvEIVGOY7zrnscV4 Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:18:57.907966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c6be9a9db45a423c9f4baec61d3e0228", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}] Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: a94af170fb414928970e7353964e31c0 Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:18:57.909548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'af99cf2b-b549-400f-bad3-1bf633c6a2c4'} Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:18:57.910374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:18:57.911601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:18:57.912650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Returning 404 to user: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:18:57.912650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78916dbd-8a2a-43bb-bd55-9730d243d8c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 404 len: 111 microversion: 2.1 time: 0.030622 Aug 29 20:18:57.912650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 300/582] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:57 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:18:57.921761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:57.924076 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:57.930999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.935803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.936287 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.937049 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:57.937568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:57.937962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:57.973276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6d37eee8-5541-4c64-bcc9-c21d64a20dde tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055494 Aug 29 20:18:57.978212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 283/583] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:18:57 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:58.065905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1120945138", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-493868041", "security_groups": [{"name": "tempest-secgroup-smoke-645306244"}], "block_device_mapping_v2": [{"uuid": "89248417-33c4-4fec-9b0e-8bb98dc1776e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93b3736e-f236-4f4c-bc10-39fdec95bd29"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:18:58.181460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] validate_networks() for [('93b3736e-f236-4f4c-bc10-39fdec95bd29', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:18:58.587908 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:18:58.588330 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:18:58.588799 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:18:58.589202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:18:58.589609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:18:58.599600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.600206 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.600783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.601546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.602122 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.602679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.620357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:18:58.624259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for user a94af170fb414928970e7353964e31c0 and project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:18:58.687793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:18:58.689938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89248417-33c4-4fec-9b0e-8bb98dc1776e',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:18:58.821793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-835c1bca-e128-4a2c-8075-eab49481295d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.760086 Aug 29 20:18:58.826509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 301/584] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:18:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:18:58.834625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-37b5583d-6b5c-43a0-a726-caf746eefd66 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:58.835314 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-37b5583d-6b5c-43a0-a726-caf746eefd66 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:58.889915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-37b5583d-6b5c-43a0-a726-caf746eefd66 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:18:58.897476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-37b5583d-6b5c-43a0-a726-caf746eefd66 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1097 microversion: 2.1 time: 0.066895 Aug 29 20:18:58.898180 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 284/585] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:58 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1097 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:58.985692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:58.988115 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:58.994173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.994659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.995111 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:58.995810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:58.996301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:58.996798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.029577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c989516-dabf-4da4-b744-96bf84b85709 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047807 Aug 29 20:18:59.030143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 302/586] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:18:58 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:18:59.919568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:18:59.920267 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:18:59.928105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.928587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.929024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.929716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:18:59.930171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:18:59.930595 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:18:59.992684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:00.000381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c8712e33-d3f2-4b34-8e7b-2dfd9d0ae881 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1195 microversion: 2.1 time: 0.084670 Aug 29 20:19:00.000975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 285/587] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:18:59 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1195 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:00.041930 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:00.044375 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:00.059632 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:00.060229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:00.060764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:00.061899 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:00.062361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:00.062782 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:00.095262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ef7c6de-9261-43b9-aed9-370954ae25ef tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056673 Aug 29 20:19:00.099678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 303/588] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:00 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:01.021418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:01.022081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:01.029159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.029651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.030085 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.030800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.031299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.031726 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.110799 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:01.113709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:01.128492 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.129024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.129464 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.137715 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.138205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.138638 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.205569 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:01.211296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-852c797c-9df4-4d47-9ab5-131916f7058c tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107593 Aug 29 20:19:01.211883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 304/589] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:01 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:01.218090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-cd0b9a7d-54a2-4f3b-a2ee-745cd123566f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1280 microversion: 2.1 time: 0.201201 Aug 29 20:19:01.218898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 286/590] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:01 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:01.674789 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-145fa52f-b277-4381-afc5-86c776dab98b req-9a054ea4-bb34-4c6f-9d39-988f7558e214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ef443f-53dc-4751-a283-a8a4bbe30704", "tag": "fed44f86-4ac1-400d-89f5-f2f62741117b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:01.686736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-145fa52f-b277-4381-afc5-86c776dab98b req-9a054ea4-bb34-4c6f-9d39-988f7558e214 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:01.687339 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-145fa52f-b277-4381-afc5-86c776dab98b req-9a054ea4-bb34-4c6f-9d39-988f7558e214 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:01.687840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-145fa52f-b277-4381-afc5-86c776dab98b req-9a054ea4-bb34-4c6f-9d39-988f7558e214 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:01.699561 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-145fa52f-b277-4381-afc5-86c776dab98b req-9a054ea4-bb34-4c6f-9d39-988f7558e214 service nova] Creating event network-changed:fed44f86-4ac1-400d-89f5-f2f62741117b for instance 56ef443f-53dc-4751-a283-a8a4bbe30704 on hv-cinder-85426 Aug 29 20:19:01.705137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-145fa52f-b277-4381-afc5-86c776dab98b req-9a054ea4-bb34-4c6f-9d39-988f7558e214 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033395 Aug 29 20:19:01.705805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 305/591] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:19:02.224384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:02.226671 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:02.233713 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.236319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.236319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.236319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.236678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.236885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.241874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:02.243136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:02.251012 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.251540 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.251986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.252698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.255464 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.256862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.273580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8321d329-3653-4b10-bdd4-de9ccac95fee tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054091 Aug 29 20:19:02.274591 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 287/592] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:02 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:02.394685 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "126a17bd-2115-40d5-92bd-bd1dffedc98c"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:02.397466 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:02.416106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.418801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.419357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.421081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.421610 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.423857 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.425853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:02.448359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7f3fe56-9a06-4e63-a9ee-b9a7ce4515df tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1280 microversion: 2.1 time: 0.210406 Aug 29 20:19:02.450146 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 306/593] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:02 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:02.513127 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Invalid volume: volume 126a17bd-2115-40d5-92bd-bd1dffedc98c is already attached to instances: 4c624a0f-156c-4f96-b9f9-a418c1a47066 Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: POST /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments HTTP/1.1 Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 74 Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:19:02.514971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {"volumeAttachment": {"volumeId": "126a17bd-2115-40d5-92bd-bd1dffedc98c"}} Aug 29 20:19:02.517158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Invalid volume: volume 126a17bd-2115-40d5-92bd-bd1dffedc98c is already attached to instances: 4c624a0f-156c-4f96-b9f9-a418c1a47066 Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'server_id': '4c624a0f-156c-4f96-b9f9-a418c1a47066', 'body': {'volumeAttachment': {'volumeId': '126a17bd-2115-40d5-92bd-bd1dffedc98c'}}} Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 126a17bd-2115-40d5-92bd-bd1dffedc98c is already attached to instances: 4c624a0f-156c-4f96-b9f9-a418c1a47066 Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:02.518500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 126a17bd-2115-40d5-92bd-bd1dffedc98c is already attached to instances: 4c624a0f-156c-4f96-b9f9-a418c1a47066 Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:02.519870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 126a17bd-2115-40d5-92bd-bd1dffedc98c is already attached to instances: 4c624a0f-156c-4f96-b9f9-a418c1a47066 Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 400 to user: Invalid volume: volume 126a17bd-2115-40d5-92bd-bd1dffedc98c is already attached to instances: 4c624a0f-156c-4f96-b9f9-a418c1a47066 {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c66a3c54-172c-4249-9457-707776e34540 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127977 Aug 29 20:19:02.521064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 288/594] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:19:02 2022] POST /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:19:02.589493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:02.589965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:02.595965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.596442 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.596868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.597552 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.598001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.598419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.682078 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lazy-loading 'services' on Instance uuid 4c624a0f-156c-4f96-b9f9-a418c1a47066 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:02.771864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17ab4184-e5c7-4c3d-911f-964d884fad7b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments/126a17bd-2115-40d5-92bd-bd1dffedc98c" status: 202 len: 0 microversion: 2.1 time: 0.185985 Aug 29 20:19:02.772502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 307/595] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:19:02 2022] DELETE /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments/126a17bd-2115-40d5-92bd-bd1dffedc98c => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:19:02.781308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:02.783704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:02.791616 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.792107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.792542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.793239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:02.793887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:02.794308 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:02.827834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5fe82158-1603-4cd9-83dc-d86a58fd1612 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050595 Aug 29 20:19:02.828693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 289/596] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:02 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:03.287631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:03.289849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:03.295966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.296514 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.296970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.298275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.298748 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.299194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.328745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee307fc1-fb96-4cc5-9435-a4f16ae668ec tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046540 Aug 29 20:19:03.329853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 308/597] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:03 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:19:03.407871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:03.408589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:03.414969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.415485 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.415921 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.416616 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.417067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.417512 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.441801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:19:03.470484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:03.471105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:03.478410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.478985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.479482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.480392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.480890 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.481323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.526412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-28ca8e72-dccc-43b9-88dc-1707cf83f121 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "DELETE /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 204 len: 0 microversion: 2.1 time: 0.122800 Aug 29 20:19:03.527230 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 290/598] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:19:03 2022] DELETE /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:19:03.536191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:03.536888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:03.543103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.543535 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.543970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.544664 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.545120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.545549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.670679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:03.678731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72262871-45bf-4eb1-a1e7-c6e2bb335c1d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.212658 Aug 29 20:19:03.679424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 309/599] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:03 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:03.716828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:03.724754 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-58bea769-3f95-4174-9228-f1eef3992d59 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1692 microversion: 2.1 time: 0.193403 Aug 29 20:19:03.725322 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 291/600] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:03 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:03.840434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:03.842508 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:03.849041 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.849531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.849965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.850662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:03.851142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:03.851568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:03.881306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4a2a537-d2f1-4ef8-962f-7b985f7d5d6b tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Aug 29 20:19:03.881862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 310/601] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:03 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:04.700128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:04.700824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:04.707221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.707705 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.708140 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.708920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.709385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.709808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.727668 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:04.746501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:04.747127 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:04.754557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.755044 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.755512 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.756219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.756678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.757105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.761458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:04.892856 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:04.900868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-67799e1e-d17e-41ce-8937-008bb8db35ed tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.204534 Aug 29 20:19:04.901440 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 292/602] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:04 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:04.905935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:04.908704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:04.914612 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.915325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.915934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.916811 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:04.917377 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:04.918076 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:04.930120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:04.938018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b0ddd9a-c37c-424e-834f-e94ff14f6c04 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1692 microversion: 2.1 time: 0.195441 Aug 29 20:19:04.938694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 311/603] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:04 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:04.952382 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7c43e427-32de-499b-bf3d-0e6e578cb736 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049738 Aug 29 20:19:04.952962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 293/604] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:04 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:05.922982 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:05.924142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:05.930755 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.931281 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.931715 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.932403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.932860 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.933281 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.960288 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:05.960907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:05.967394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.967880 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.968310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:05.969001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:05.969456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:05.969873 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.111611 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:06.119484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36a32402-13f3-4850-9a18-e447588999a2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.200375 Aug 29 20:19:06.120240 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 312/605] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:05 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:06.124564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:06.126776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:06.133453 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.133936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.134363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.135057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:06.135527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:06.135943 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:06.139029 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:06.146785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-92f98e7c-e76d-447e-bbee-11cadb1eb24f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1692 microversion: 2.1 time: 0.190393 Aug 29 20:19:06.147579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 294/606] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:05 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:06.165626 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13335c1f-099c-42ea-8694-455567f0abd0 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Aug 29 20:19:06.166174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 313/607] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:06 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:07.140786 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:07.141394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:07.148022 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.148502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.149198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.149885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.150348 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.151133 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.169084 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:07.169913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:07.177945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.178543 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.178991 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.179761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.180227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.180653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.337558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:07.345674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-af4c3ff7-c079-4eee-b903-4dd71236fdbc tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.208689 Aug 29 20:19:07.358960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 295/608] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:07 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:07.358960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:07.361210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:07.364366 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:07.368412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.369290 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.369739 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.370461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:07.370938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:07.371542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:07.373618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d1cb7f3-b1fd-4915-8966-b227ea384f81 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1692 microversion: 2.1 time: 0.209059 Aug 29 20:19:07.374945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 314/609] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:07 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1692 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:07.407029 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-77d1b3ec-8391-40ad-a3ae-043376bd9138 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051841 Aug 29 20:19:07.408266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 296/610] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:07 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:08.327000 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a9d84f2c-62f1-4454-9b90-e5d6c4de137c req-6144773d-7f2f-46f7-9257-fe6e52fc6c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89712622-db65-462f-a0eb-356e69bbadb3", "name": "network-vif-deleted", "tag": "3bbced07-f74b-4bb6-92a2-a4de1b3dba60"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:08.347842 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9d84f2c-62f1-4454-9b90-e5d6c4de137c req-6144773d-7f2f-46f7-9257-fe6e52fc6c58 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.348622 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9d84f2c-62f1-4454-9b90-e5d6c4de137c req-6144773d-7f2f-46f7-9257-fe6e52fc6c58 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.349142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a9d84f2c-62f1-4454-9b90-e5d6c4de137c req-6144773d-7f2f-46f7-9257-fe6e52fc6c58 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.367853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:08.368470 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:08.373611 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a9d84f2c-62f1-4454-9b90-e5d6c4de137c req-6144773d-7f2f-46f7-9257-fe6e52fc6c58 service nova] Creating event network-vif-deleted:3bbced07-f74b-4bb6-92a2-a4de1b3dba60 for instance 89712622-db65-462f-a0eb-356e69bbadb3 on hv-cinder-85426 Aug 29 20:19:08.379268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.379975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.381224 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.385685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a9d84f2c-62f1-4454-9b90-e5d6c4de137c req-6144773d-7f2f-46f7-9257-fe6e52fc6c58 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062241 Aug 29 20:19:08.386192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.386684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.387134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.389304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 315/611] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:08.400382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:08.406708 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:08.425252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.425740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.426175 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.428525 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.432317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.432997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.475258 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.475941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.476693 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.477428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'fault' on Instance uuid 89712622-db65-462f-a0eb-356e69bbadb3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:08.533673 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:08.550891 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d58b11fa-f9f6-4586-b0fa-6fc8f88718eb tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1340 microversion: 2.1 time: 0.158729 Aug 29 20:19:08.551736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 316/612] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:08 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1340 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:08.556461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:08.558606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:08.566467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.566958 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.567418 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.568526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.569128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.569726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.611459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:08.618458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ab30ada-0627-4ab5-9a5e-7a24f3596a78 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065764 Aug 29 20:19:08.619235 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 317/613] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:19:08 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:19:08.643804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:08.652150 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3ed49493-3cfa-43e0-94ab-40c69f4c01b9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.289491 Aug 29 20:19:08.652777 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 297/614] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:08 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:08.688360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:08.688867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:08.692399 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:08.697994 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.698509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.698965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.699690 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.700172 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.700600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.727409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:19:08.809174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7f75f85-25de-498c-a165-4c317474dcef tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 204 len: 0 microversion: 2.1 time: 0.124522 Aug 29 20:19:08.809896 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 318/615] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:19:08 2022] DELETE /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:19:08.818882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:08.819670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:08.826050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.826656 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.827208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.827975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:08.828494 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:08.828920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:08.894378 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:08.975714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:08.983513 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-86d932b8-6fde-4d2a-af36-8d1e75d4eefa tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1686 microversion: 2.1 time: 0.169353 Aug 29 20:19:08.984082 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 298/616] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:08 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:09.572017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:09.572913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:09.579352 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.579839 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.580274 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.580972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.581429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.581854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.613961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.614427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.614864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.615411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'fault' on Instance uuid 89712622-db65-462f-a0eb-356e69bbadb3 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:09.656992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:09.666401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6e29ade-80f7-4780-ad81-ba8c86f82881 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1340 microversion: 2.1 time: 0.098578 Aug 29 20:19:09.666885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 319/617] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:09 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:09.678323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:09.678323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:09.680359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.680844 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.681271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.681968 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:09.682417 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:09.682834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:09.812438 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:09.820236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5cc81761-bb8f-4414-af77-302fb7c78ae9 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.151462 Aug 29 20:19:09.820870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 299/618] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:09 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:10.004486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:10.005179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:10.011298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.011780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.012211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.012891 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.013341 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.013758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.144023 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:10.151906 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe64e00b-8018-4be9-a30d-40e6a908bb0a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1686 microversion: 2.1 time: 0.151339 Aug 29 20:19:10.152478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 320/619] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:09 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:10.688731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:10.690027 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:10.696471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.696951 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.697385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.698075 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.698533 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.698957 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.729142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.729661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.730100 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.730550 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'fault' on Instance uuid 89712622-db65-462f-a0eb-356e69bbadb3 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:10.770910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:10.778922 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-12c121f0-96ee-4222-9964-9384180e3f44 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 200 len: 1340 microversion: 2.1 time: 0.094098 Aug 29 20:19:10.779520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 300/620] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:10 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:10.841392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:10.841938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:10.849060 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.849548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.850078 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.850778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:10.851262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:10.851690 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:10.984369 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:10.992779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6000702-0719-4cba-984a-8de9552f58d3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.155299 Aug 29 20:19:10.993348 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 321/621] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:10 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:11.172090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:11.172701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:11.179460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:11.179938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:11.180370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:11.181127 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:11.181582 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:11.182000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:11.314435 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:11.324233 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b584a5f7-af7c-46c0-b4aa-39b0cefc96ca tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1686 microversion: 2.1 time: 0.155351 Aug 29 20:19:11.324996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 301/622] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:11 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:11.799334 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:11.800055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 89712622-db65-462f-a0eb-356e69bbadb3] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:11.807784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:11.808345 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:11.808844 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:11.809615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:11.810144 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:11.810654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:11.824575 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] HTTP exception thrown: Instance 89712622-db65-462f-a0eb-356e69bbadb3 could not be found. Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Request method failure captured: Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 HTTP/1.1 Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR3-Cs8s_ULLOsdfgfc5xj3VhVd6z9RFUxXBqIwc9ZHVvI7-RhGZMkEFM-bcV4zf9lWw5NFP1E_1eH7sNNtouuLUBpyU6Qe8qwt_QE8WcJ6oe_ICBeRcRy_CUHp4qTV4NWCaMW7GAD_FqOnxLPhxSUFc7L9Vobg8cMSwBwbBL1mmGSY Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:19:11.826219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_eaabbc4be9754bcda6adc796a0340c49", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}] Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 58bf9cf55cfc45d3841366f601abe4f8 Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 89712622-db65-462f-a0eb-356e69bbadb3 could not be found. Aug 29 20:19:11.827761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '89712622-db65-462f-a0eb-356e69bbadb3'} Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89712622-db65-462f-a0eb-356e69bbadb3 could not be found. Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:19:11.828504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89712622-db65-462f-a0eb-356e69bbadb3 could not be found. Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89712622-db65-462f-a0eb-356e69bbadb3 could not be found. Aug 29 20:19:11.830306 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:11.831410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Returning 404 to user: Instance 89712622-db65-462f-a0eb-356e69bbadb3 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:19:11.831410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3a1374e-1f8b-4b02-8b13-6edc27498ce2 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3" status: 404 len: 111 microversion: 2.1 time: 0.032405 Aug 29 20:19:11.832411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 322/623] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:11 2022] GET /compute/v2.1/servers/89712622-db65-462f-a0eb-356e69bbadb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:19:11.838349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-75f8da23-a055-4cf0-a3db-3b67adac7c0f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '.version_select at 0x7f4469404dc0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:11.863152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-75f8da23-a055-4cf0-a3db-3b67adac7c0f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207543991" status: 202 len: 0 microversion: 2.1 time: 0.029262 Aug 29 20:19:11.867388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 302/624] 10.222.0.121 () {58 vars in 1226 bytes} [Mon Aug 29 20:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207543991 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:19:12.013821 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:12.014437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:12.024267 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.024988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.025487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.026187 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.026794 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.027393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.184898 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:12.193403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e9d88f6-5eee-4037-ae2a-8f09d6c51f02 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.183707 Aug 29 20:19:12.194066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 323/625] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:12 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:12.348798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:12.349413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:12.356872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.357375 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.357806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.358527 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.359046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.359503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.435859 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:12.446624 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1066cc58-095f-455f-b75e-c17d4d833ded tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 200 len: 1618 microversion: 2.1 time: 0.102798 Aug 29 20:19:12.448024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 303/626] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:12 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 1618 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:12.594752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e3847bf1-d9f8-4892-8d68-3133a2d72c73 req-e599a310-ec64-4501-9164-8c1a68921c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c624a0f-156c-4f96-b9f9-a418c1a47066", "name": "network-vif-deleted", "tag": "e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:12.618736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3847bf1-d9f8-4892-8d68-3133a2d72c73 req-e599a310-ec64-4501-9164-8c1a68921c63 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.619301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3847bf1-d9f8-4892-8d68-3133a2d72c73 req-e599a310-ec64-4501-9164-8c1a68921c63 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.619953 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3847bf1-d9f8-4892-8d68-3133a2d72c73 req-e599a310-ec64-4501-9164-8c1a68921c63 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.642714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e3847bf1-d9f8-4892-8d68-3133a2d72c73 req-e599a310-ec64-4501-9164-8c1a68921c63 service nova] Creating event network-vif-deleted:e7c6ccf8-629f-49b9-8c60-3e3a49d11ca5 for instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 on hv-cinder-85426 Aug 29 20:19:12.643725 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:12.644291 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:12.651442 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e3847bf1-d9f8-4892-8d68-3133a2d72c73 req-e599a310-ec64-4501-9164-8c1a68921c63 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140751 Aug 29 20:19:12.652652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 324/627] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:12.664187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.664972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.665651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.667525 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:12.668062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:12.668553 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:12.694481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0d929de2-6900-42f7-8433-b100eb394a4c tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/ips" status: 200 len: 150 microversion: 2.20 time: 0.142013 Aug 29 20:19:12.696398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 304/628] 10.222.0.121 () {60 vars in 1294 bytes} [Mon Aug 29 20:19:12 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/ips => generated 150 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:19:13.215178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:13.215958 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:13.222394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:13.222888 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:13.223352 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:13.224088 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:13.224785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:13.224983 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:13.392938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:13.404058 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8d39559-8a14-4a48-9c8c-cf1ec624f248 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.193777 Aug 29 20:19:13.417270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 325/629] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:13 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:13.463623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-597d1a28-389e-456e-a4bd-793abb9089fa req-6bd32fac-5f8d-42cd-8a69-be8e7d04eebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ef443f-53dc-4751-a283-a8a4bbe30704", "name": "network-vif-plugged", "status": "completed", "tag": "fed44f86-4ac1-400d-89f5-f2f62741117b"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:13.472073 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:13.473210 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:13.476411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-597d1a28-389e-456e-a4bd-793abb9089fa req-6bd32fac-5f8d-42cd-8a69-be8e7d04eebb service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:13.476975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-597d1a28-389e-456e-a4bd-793abb9089fa req-6bd32fac-5f8d-42cd-8a69-be8e7d04eebb service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:13.477644 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-597d1a28-389e-456e-a4bd-793abb9089fa req-6bd32fac-5f8d-42cd-8a69-be8e7d04eebb service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:13.481057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:13.481740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:13.482418 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:13.483542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:13.484188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:13.485620 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:13.491640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-597d1a28-389e-456e-a4bd-793abb9089fa req-6bd32fac-5f8d-42cd-8a69-be8e7d04eebb service nova] Creating event network-vif-plugged:fed44f86-4ac1-400d-89f5-f2f62741117b for instance 56ef443f-53dc-4751-a283-a8a4bbe30704 on hv-cinder-85426 Aug 29 20:19:13.496707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-597d1a28-389e-456e-a4bd-793abb9089fa req-6bd32fac-5f8d-42cd-8a69-be8e7d04eebb service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037235 Aug 29 20:19:13.497416 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 305/630] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:13.503125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 HTTP/1.1 Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:19:13.504918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:19:13.506430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '4c624a0f-156c-4f96-b9f9-a418c1a47066'} Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:19:13.507530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:19:13.508742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:13.509866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:19:13.509866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ae98c47-69b7-4ef3-816f-995ce458a0dd tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 404 len: 111 microversion: 2.1 time: 0.040828 Aug 29 20:19:13.510893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 326/631] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:13 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:19:13.515663 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-32e13890-ce38-47a3-8717-b1054e2c794c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '.version_select at 0x7f4469448e50>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:13.538626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-32e13890-ce38-47a3-8717-b1054e2c794c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706986606" status: 202 len: 0 microversion: 2.1 time: 0.027135 Aug 29 20:19:13.540035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 306/632] 10.222.0.121 () {58 vars in 1223 bytes} [Mon Aug 29 20:19:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706986606 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:19:14.149420 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7843a78a-cfa2-44dd-9d7a-9828050848c4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: .version_select at 0x7f4469406b80>, body: {"keypair": {"name": "tempest-keypair-300913440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQxoXe/nBCEffgFPtxMeETukUg+Os9vqoHb0lQfagWLUyHs3er4im7t21QFPgHl0tp3VCD4nJJYVo5Nn3Xw0cDsPIrJ//LyND6HVvOZvRnzm0xVGiopdQa6GQ3Q9X6i8g=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:14.159858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:14.167616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7843a78a-cfa2-44dd-9d7a-9828050848c4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:19:14.172536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7843a78a-cfa2-44dd-9d7a-9828050848c4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:19:14.195769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7843a78a-cfa2-44dd-9d7a-9828050848c4 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050431 Aug 29 20:19:14.196562 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 327/633] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:19:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:14.425643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:14.426435 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:14.432565 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:14.433153 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:14.433467 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:14.434609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:14.435398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:14.436002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:14.582511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:14.597062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-05af5e80-bbcc-4fe4-9515-759b80881eee tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1268 microversion: 2.1 time: 0.175879 Aug 29 20:19:14.597627 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 307/634] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:14 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:14.733156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:14.733724 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:14.743072 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:14.743585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:14.744027 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:14.744727 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:14.745189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:14.745663 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:14.769719 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lazy-loading 'flavor' on Instance uuid 2853ad5d-1f93-4b5b-841b-b663e207546e {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:14.791173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:14.962082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93b7b476-4cfd-4373-9996-cfa6b174dc02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/action" status: 202 len: 0 microversion: 2.20 time: 0.233341 Aug 29 20:19:14.962817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 328/635] 10.222.0.121 () {62 vars in 1324 bytes} [Mon Aug 29 20:19:14 2022] POST /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:19:14.972042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:14.972630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:14.978926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:14.979456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:14.979902 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:14.980614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:14.981076 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:14.981504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.117884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:15.118631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:15.127400 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.127963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.128464 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.129324 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.129796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.130356 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.140461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.152539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.154182 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.155725 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-99d78f90-4ce7-446e-9c1c-4bbe227c19e0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.188494 Aug 29 20:19:15.156476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 308/636] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:14 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:19:15.159756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:19:15.238108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc432e41-5600-45c5-b8ec-63eb477f3c9f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "DELETE /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 204 len: 0 microversion: 2.1 time: 0.124125 Aug 29 20:19:15.238991 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 329/637] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:19:15 2022] DELETE /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:19:15.247016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:15.247651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:15.254247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.254732 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.255196 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.256065 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.256527 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.256953 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.388701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.396758 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1f779fa6-61aa-4f9c-83e2-6f840d040a03 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1511 microversion: 2.1 time: 0.153484 Aug 29 20:19:15.397349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 309/638] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:15 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:15.618664 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:15.619536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:15.625423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.625908 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.626835 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.627555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.628014 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.628434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.721434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-56623831", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "190f63a4-9b8c-4268-a1f5-7e230ea6f86c"}], "security_groups": [{"name": "tempest-securitygroup--900985600"}], "key_name": "tempest-keypair-300913440", "user_data": "}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:15.768656 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:15.777219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c14d5697-5dd6-4362-9979-d07b0869215a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1455 microversion: 2.1 time: 0.163079 Aug 29 20:19:15.777780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 330/639] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:15 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:15.797652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:15.798897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:15.804893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.805378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.805961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.806654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:15.807131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:15.807554 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:15.825143 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] validate_networks() for [('190f63a4-9b8c-4268-a1f5-7e230ea6f86c', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:19:16.200319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.208153 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2787a4c9-bfcd-42cf-9bfb-6b667189b4a5 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1455 microversion: 2.1 time: 0.414785 Aug 29 20:19:16.208936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 331/640] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:15 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1455 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:16.213569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:16.214179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:16.220498 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.220977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.221409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.222096 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.222550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.222970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.421459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.431265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.432716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.433902 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-469081d6-a4ba-4612-8ca9-1569dedccbca tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.224005 Aug 29 20:19:16.434790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 332/641] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:16 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:16.440763 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:16.441592 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:16.447380 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.448081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.448694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.449557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.450182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.450609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.617034 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:19:16.617595 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:19:16.618081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:19:16.618512 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:19:16.619102 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:19:16.628634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.629451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.630055 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.630795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:16.631285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:16.631894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:16.644849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.651986 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:19:16.653581 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63891eb7-f690-412b-a712-01b8760b3dd6 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1511 microversion: 2.1 time: 0.216985 Aug 29 20:19:16.654401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 333/642] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:16 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:16.656779 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Getting quotas for user c0d284a41f9b4326a99c6a59a2f0c290 and project 9d67fdb2b34644659a8054ecf10999cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:19:16.669230 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:19:16.671657 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:19:16.719341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d1149279-1869-4752-ae30-df3fda64a6e7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.002284 Aug 29 20:19:16.720767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 310/643] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:19:15 2022] POST /compute/v2.1/servers => generated 403 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 29 20:19:16.737084 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d216b6d-c221-4327-9994-937729252f55 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:16.738403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d216b6d-c221-4327-9994-937729252f55 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:16.799573 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3d216b6d-c221-4327-9994-937729252f55 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:16.811125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d216b6d-c221-4327-9994-937729252f55 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1243 microversion: 2.1 time: 0.083468 Aug 29 20:19:16.811977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 334/644] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:16 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1243 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:17.458643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:17.458643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:17.462035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:17.465914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.466613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.466845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.467585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.468047 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.468473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.603503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.612318 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.613761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.614932 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fcb51f69-2e22-4958-ae20-e5aedc1172fa tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.161435 Aug 29 20:19:17.615537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 311/645] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:17 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:17.675450 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:17.676077 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:17.682078 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.682570 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.683011 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.683738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.684205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.684636 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.818187 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.831707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-26000a04-2106-49f7-897f-400d5977490b tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1511 microversion: 2.1 time: 0.160699 Aug 29 20:19:17.833786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 335/646] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:17 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:17.836820 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:17.837707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:17.853356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.853935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.854370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.855108 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.855581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.855961 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.877997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b5d74b3a-128c-4e1d-b10e-6e531e4e9e30 req-71a6e5df-8453-425d-a3a6-38d0c90fa656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ef443f-53dc-4751-a283-a8a4bbe30704", "tag": "fed44f86-4ac1-400d-89f5-f2f62741117b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:17.890293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b5d74b3a-128c-4e1d-b10e-6e531e4e9e30 req-71a6e5df-8453-425d-a3a6-38d0c90fa656 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:17.890409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b5d74b3a-128c-4e1d-b10e-6e531e4e9e30 req-71a6e5df-8453-425d-a3a6-38d0c90fa656 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:17.890806 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b5d74b3a-128c-4e1d-b10e-6e531e4e9e30 req-71a6e5df-8453-425d-a3a6-38d0c90fa656 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:17.892398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=100 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:17.906269 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b5d74b3a-128c-4e1d-b10e-6e531e4e9e30 req-71a6e5df-8453-425d-a3a6-38d0c90fa656 service nova] Creating event network-changed:fed44f86-4ac1-400d-89f5-f2f62741117b for instance 56ef443f-53dc-4751-a283-a8a4bbe30704 on hv-cinder-85426 Aug 29 20:19:17.911201 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b5d74b3a-128c-4e1d-b10e-6e531e4e9e30 req-71a6e5df-8453-425d-a3a6-38d0c90fa656 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037623 Aug 29 20:19:17.911798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 336/647] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:17.944263 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:17.951993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3aec62fb-ff72-4df7-b5c2-3ca5b79a38c2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1247 microversion: 2.1 time: 0.121284 Aug 29 20:19:17.952558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 312/648] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:17 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1247 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:18.640649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:18.641427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:18.648353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.648961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.649315 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:18.650026 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.650484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.650909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:18.857948 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:18.858578 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:18.874657 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.875206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.876691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:18.881323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.887766 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.888495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:18.920275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:18.932720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:18.934265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:18.935566 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18848ae2-6117-4aa5-bbad-ee720ef30bff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.299832 Aug 29 20:19:18.939675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 337/649] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:18 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:18.977591 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:18.978782 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:18.991140 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.991923 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.992559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:18.993783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:18.994421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:18.995034 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:19.062126 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:19.072654 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-133902fc-4f41-45ec-82e4-98ffb6102a7d tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 200 len: 1297 microversion: 2.1 time: 0.222235 Aug 29 20:19:19.073259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 313/650] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:18 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 1297 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:19.155849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:19.164717 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7755fde5-a53a-41c4-95eb-544800aff1f7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1313 microversion: 2.1 time: 0.193158 Aug 29 20:19:19.167447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 338/651] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:18 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:19.927877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-394d0f9a-a8ca-45b4-b019-a0f924d8a422 req-886184a3-49c5-400a-9edb-3c9a826bacfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489e0150-911d-4e6b-9bd1-15903a23dc3c", "name": "network-vif-deleted", "tag": "882553ff-4ac3-48cc-9d4b-77e541c96a98"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:19.939266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-394d0f9a-a8ca-45b4-b019-a0f924d8a422 req-886184a3-49c5-400a-9edb-3c9a826bacfd service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:19.939819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-394d0f9a-a8ca-45b4-b019-a0f924d8a422 req-886184a3-49c5-400a-9edb-3c9a826bacfd service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:19.940321 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-394d0f9a-a8ca-45b4-b019-a0f924d8a422 req-886184a3-49c5-400a-9edb-3c9a826bacfd service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:19.952515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-394d0f9a-a8ca-45b4-b019-a0f924d8a422 req-886184a3-49c5-400a-9edb-3c9a826bacfd service nova] Creating event network-vif-deleted:882553ff-4ac3-48cc-9d4b-77e541c96a98 for instance 489e0150-911d-4e6b-9bd1-15903a23dc3c on hv-cinder-85426 Aug 29 20:19:19.958203 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-394d0f9a-a8ca-45b4-b019-a0f924d8a422 req-886184a3-49c5-400a-9edb-3c9a826bacfd service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034211 Aug 29 20:19:19.958898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 314/652] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:19.967729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:19.968344 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:19.974691 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:19.975344 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:19.975986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:19.976798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:19.977653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:19.978169 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.095901 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:20.096736 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 489e0150-911d-4e6b-9bd1-15903a23dc3c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:20.104029 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.105258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.106170 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.107049 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.108000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.108941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.115407 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.124605 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.125044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] HTTP exception thrown: Instance 489e0150-911d-4e6b-9bd1-15903a23dc3c could not be found. Aug 29 20:19:20.126716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Request method failure captured: Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c HTTP/1.1 Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR3-Cs8s_ULLOsdfgfc5xj3VhVd6z9RFUxXBqIwc9ZHVvI7-RhGZMkEFM-bcV4zf9lWw5NFP1E_1eH7sNNtouuLUBpyU6Qe8qwt_QE8WcJ6oe_ICBeRcRy_CUHp4qTV4NWCaMW7GAD_FqOnxLPhxSUFc7L9Vobg8cMSwBwbBL1mmGSY Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:19:20.126892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_eaabbc4be9754bcda6adc796a0340c49", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}] Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 58bf9cf55cfc45d3841366f601abe4f8 Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 489e0150-911d-4e6b-9bd1-15903a23dc3c could not be found. Aug 29 20:19:20.128412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '489e0150-911d-4e6b-9bd1-15903a23dc3c'} Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489e0150-911d-4e6b-9bd1-15903a23dc3c could not be found. Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:19:20.132505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489e0150-911d-4e6b-9bd1-15903a23dc3c could not be found. Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489e0150-911d-4e6b-9bd1-15903a23dc3c could not be found. Aug 29 20:19:20.133852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:19:20.135114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Returning 404 to user: Instance 489e0150-911d-4e6b-9bd1-15903a23dc3c could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:19:20.135114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-da010f79-967c-4801-9b91-56f9798ac06e tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c" status: 404 len: 111 microversion: 2.1 time: 0.038914 Aug 29 20:19:20.135114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 315/653] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:20 2022] GET /compute/v2.1/servers/489e0150-911d-4e6b-9bd1-15903a23dc3c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:19:20.137090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:20.137405 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6fdde43-c30b-4722-8772-95f6f0db6561 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.173814 Aug 29 20:19:20.138425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 339/654] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:19 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:20.147624 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:20.159867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.160352 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.160907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.161598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.162176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.162596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.186612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:20.187359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:20.189707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:19:20.194189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.194675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.195398 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.196105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.196556 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.197604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.284625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3890b69f-5cb6-4d0c-a5e5-1b488f85bc88 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "DELETE /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 204 len: 0 microversion: 2.1 time: 0.151037 Aug 29 20:19:20.287969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 316/655] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:19:20 2022] DELETE /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:19:20.296398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:20.297100 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:20.303672 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.304162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.304587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.306633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:20.307290 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:20.307717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:20.345045 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.354730 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b9a95d1-3958-4fc1-a8d5-0f598ef13041 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.172843 Aug 29 20:19:20.355350 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 340/656] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:20 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:20.462510 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:20.471096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c586b75e-8cf8-47b6-92c6-774e7db9dafd tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.178216 Aug 29 20:19:20.471645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 317/657] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:20 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:21.164283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:21.164883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:21.171300 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.171784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.172215 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.172943 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.173395 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.173813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.303826 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:21.312102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:21.314124 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:21.315382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f1efc62-4f5e-4482-8388-649c23c1b7c9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.154933 Aug 29 20:19:21.315943 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 341/658] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:21 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:21.376884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:21.377518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:21.384269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.384746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.385179 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.385867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.386317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.386739 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.492405 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:21.492844 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:21.498951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.499558 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.500061 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.501396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.501856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.502283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.519201 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:21.527134 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c63586fb-70f6-41f9-a034-ba8c5ad0755c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.154758 Aug 29 20:19:21.527823 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 318/659] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:21 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:21.628704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:21.636501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-532db5d7-6aaf-4e6c-a0de-e85ebc196e71 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.148915 Aug 29 20:19:21.637063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 342/660] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:21 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:21.975505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-e40d5e94-5484-4a04-855e-acb1914bccbc req-324766cd-99c3-44d8-b62d-39677ac95d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def1c4f2-303e-408b-bd60-188fbcc7e7a4", "tag": "9ebf2957-9ad5-4645-aca0-ad5124e769bb"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:21.984622 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e40d5e94-5484-4a04-855e-acb1914bccbc req-324766cd-99c3-44d8-b62d-39677ac95d9f service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:21.985602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e40d5e94-5484-4a04-855e-acb1914bccbc req-324766cd-99c3-44d8-b62d-39677ac95d9f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:21.986156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e40d5e94-5484-4a04-855e-acb1914bccbc req-324766cd-99c3-44d8-b62d-39677ac95d9f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:21.998576 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-e40d5e94-5484-4a04-855e-acb1914bccbc req-324766cd-99c3-44d8-b62d-39677ac95d9f service nova] Creating event network-changed:9ebf2957-9ad5-4645-aca0-ad5124e769bb for instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 on hv-cinder-85426 Aug 29 20:19:22.003958 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-e40d5e94-5484-4a04-855e-acb1914bccbc req-324766cd-99c3-44d8-b62d-39677ac95d9f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032248 Aug 29 20:19:22.004520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 319/661] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:22.339034 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:22.339652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:22.346553 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:22.347032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:22.347490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:22.348435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:22.348634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:22.349055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:22.476079 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:22.479628 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:22.485042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:22.486641 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:22.487837 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-944f84f6-c297-41ec-aec2-60dd5432f632 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.152782 Aug 29 20:19:22.488445 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 343/662] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:22 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:22.548412 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:22.549141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:22.555315 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:22.555791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:22.556218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:22.556924 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:22.557379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:22.557799 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:22.660632 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:22.661701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:22.668759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:22.669248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:22.669942 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:22.670804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:22.671643 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:22.672395 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:22.698968 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:22.713539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a5dbddd8-2c86-4fa7-ae22-1220f3815b85 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.169661 Aug 29 20:19:22.714132 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 320/663] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:22 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:22.814338 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:22.822505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7d80faf-ee0f-407a-9cd9-2b10a1f989d0 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1525 microversion: 2.1 time: 0.168351 Aug 29 20:19:22.823114 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 344/664] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:22 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:23.511280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:23.511886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:23.518628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:23.519135 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:23.519635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:23.520290 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:23.520749 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:23.521174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:23.670408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:23.679508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:23.681229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:23.682398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4ff76fff-bbad-4906-aae8-3c251830221e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.175177 Aug 29 20:19:23.682955 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 321/665] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:23 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:23.734786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:23.736935 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:23.743481 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:23.743967 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:23.744396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:23.745135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:23.745584 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:23.746020 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:23.845206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:23.846032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:23.855767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:23.856601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:23.857985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:23.859300 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:23.860901 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:23.861537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:23.892296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:23.897342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:23.898087 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:23.898520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:23.898965 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'fault' on Instance uuid 95ad0c45-261e-4857-a9bb-30cdd91fc949 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:23.900687 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f244adc1-ea79-41ca-84d0-a33907f19a3a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.170628 Aug 29 20:19:23.901252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 345/666] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:23 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:23.940292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:23.947920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-661a632b-4a71-4ce8-90f3-2cdb7ab86192 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1315 microversion: 2.1 time: 0.108157 Aug 29 20:19:23.948488 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 322/667] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:23 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1315 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:24.018051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5362e2c8-d895-418f-b1ea-5af206236c19 req-2fc154d5-4b73-4d4d-8dc1-bee00e16fee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ad0c45-261e-4857-a9bb-30cdd91fc949", "name": "network-vif-deleted", "tag": "f3776018-6607-4aae-859e-5e055ca8c72d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:24.028200 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5362e2c8-d895-418f-b1ea-5af206236c19 req-2fc154d5-4b73-4d4d-8dc1-bee00e16fee0 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:24.028681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5362e2c8-d895-418f-b1ea-5af206236c19 req-2fc154d5-4b73-4d4d-8dc1-bee00e16fee0 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:24.029117 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5362e2c8-d895-418f-b1ea-5af206236c19 req-2fc154d5-4b73-4d4d-8dc1-bee00e16fee0 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:24.042806 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5362e2c8-d895-418f-b1ea-5af206236c19 req-2fc154d5-4b73-4d4d-8dc1-bee00e16fee0 service nova] Creating event network-vif-deleted:f3776018-6607-4aae-859e-5e055ca8c72d for instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 on hv-cinder-85426 Aug 29 20:19:24.047609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5362e2c8-d895-418f-b1ea-5af206236c19 req-2fc154d5-4b73-4d4d-8dc1-bee00e16fee0 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Aug 29 20:19:24.048214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 346/668] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:24.705311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:24.705918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:24.712381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:24.712874 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:24.713310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:24.713997 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:24.714452 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:24.714872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:24.843926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:24.852328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:24.853763 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:24.854920 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c179f7fc-8f87-40e8-b9fa-f386896fffd9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.153554 Aug 29 20:19:24.855514 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 323/669] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:24 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:24.923979 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:24.924675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:24.932189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:24.932679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:24.933121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:24.933819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:24.934271 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:24.934696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:24.969312 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:24.970595 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:24.976985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:24.977823 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:24.978330 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:24.979146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:24.979716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:24.980237 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:25.014662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:25.015389 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:25.015898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:25.016459 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lazy-loading 'fault' on Instance uuid 95ad0c45-261e-4857-a9bb-30cdd91fc949 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:19:25.075499 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bf9cf55cfc45d3841366f601abe4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaabbc4be9754bcda6adc796a0340c49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:25.082580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-df082140-0102-442c-9c3a-c8fb2e669a6f tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 200 len: 1315 microversion: 2.1 time: 0.116993 Aug 29 20:19:25.095180 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 324/670] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:24 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 1315 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:25.100390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:25.108548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c023e91-6b33-4d55-86df-62afa7198610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.189834 Aug 29 20:19:25.109110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 347/671] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:24 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:25.878322 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:25.878956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:25.885607 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:25.886107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:25.886578 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:25.887318 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:25.887785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:25.888214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.021312 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:26.029840 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:26.031324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:26.032495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b6f19391-9962-4092-99c4-d7d0a65c4838 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.158668 Aug 29 20:19:26.033074 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 325/672] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:25 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:26.103980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:26.104639 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] [instance: 95ad0c45-261e-4857-a9bb-30cdd91fc949] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:26.111125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.111613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.112041 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.112722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.113266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.113764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.127590 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] HTTP exception thrown: Instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 could not be found. Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Request method failure captured: Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 HTTP/1.1 Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR3-Cs8s_ULLOsdfgfc5xj3VhVd6z9RFUxXBqIwc9ZHVvI7-RhGZMkEFM-bcV4zf9lWw5NFP1E_1eH7sNNtouuLUBpyU6Qe8qwt_QE8WcJ6oe_ICBeRcRy_CUHp4qTV4NWCaMW7GAD_FqOnxLPhxSUFc7L9Vobg8cMSwBwbBL1mmGSY Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:19:26.129244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_eaabbc4be9754bcda6adc796a0340c49", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/eaabbc4be9754bcda6adc796a0340c49"}]}] Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: eaabbc4be9754bcda6adc796a0340c49 Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1608266264 Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 58bf9cf55cfc45d3841366f601abe4f8 Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1608266264-project Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 could not be found. Aug 29 20:19:26.130594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '95ad0c45-261e-4857-a9bb-30cdd91fc949'} Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 could not be found. Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:19:26.131335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 could not be found. Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 could not be found. Aug 29 20:19:26.132487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:19:26.133491 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:26.133579 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] Returning 404 to user: Instance 95ad0c45-261e-4857-a9bb-30cdd91fc949 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:19:26.133655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:26.133735 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd704f67-6899-4fe6-a708-fd8ee66b8db9 tempest-ServerRescueNegativeTestJSON-1608266264 tempest-ServerRescueNegativeTestJSON-1608266264-project] 10.222.0.121 "GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949" status: 404 len: 111 microversion: 2.1 time: 0.030723 Aug 29 20:19:26.133735 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 348/673] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:26 2022] GET /compute/v2.1/servers/95ad0c45-261e-4857-a9bb-30cdd91fc949 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:19:26.136610 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.137101 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.137543 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.138245 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:26.138706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:26.139157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:26.271130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:26.279049 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6a7e9fcd-d090-4b96-b2b1-38f5a3045bd5 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.153629 Aug 29 20:19:26.279642 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 326/674] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:26 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:27.055372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:27.056604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:27.058919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:27.069528 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:27.070277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:27.070853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:27.071590 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:27.072058 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:27.072480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:27.234098 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:27.246518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:27.248371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:27.249749 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-820176a3-eb74-4feb-aa2a-2292558337ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.198394 Aug 29 20:19:27.252075 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 349/675] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:27 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:27.300274 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:27.301046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:27.302848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:27.303529 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:27.308809 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:27.309301 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:27.309815 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:27.310423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:27.311106 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:27.311536 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:27.455513 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:27.465043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a2a8befb-0834-4f7c-a2ec-b4e3333c6010 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.169102 Aug 29 20:19:27.465647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 327/676] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:27 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:27.541686 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-01575f2e-a8a2-4a97-b5fb-09b8216c22d4 req-f1e2234a-abb9-483a-93ab-4c78933cd71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def1c4f2-303e-408b-bd60-188fbcc7e7a4", "name": "network-vif-plugged", "status": "completed", "tag": "9ebf2957-9ad5-4645-aca0-ad5124e769bb"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:27.551901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01575f2e-a8a2-4a97-b5fb-09b8216c22d4 req-f1e2234a-abb9-483a-93ab-4c78933cd71e service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:27.552385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01575f2e-a8a2-4a97-b5fb-09b8216c22d4 req-f1e2234a-abb9-483a-93ab-4c78933cd71e service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:27.552808 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01575f2e-a8a2-4a97-b5fb-09b8216c22d4 req-f1e2234a-abb9-483a-93ab-4c78933cd71e service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:27.564607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-01575f2e-a8a2-4a97-b5fb-09b8216c22d4 req-f1e2234a-abb9-483a-93ab-4c78933cd71e service nova] Creating event network-vif-plugged:9ebf2957-9ad5-4645-aca0-ad5124e769bb for instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 on hv-cinder-85426 Aug 29 20:19:27.570099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-01575f2e-a8a2-4a97-b5fb-09b8216c22d4 req-f1e2234a-abb9-483a-93ab-4c78933cd71e service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096952 Aug 29 20:19:27.571017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 350/677] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:19:28.273835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:28.274610 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:28.280893 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:28.281133 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:28.281626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:28.282362 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:28.282825 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:28.283286 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:28.416913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:28.420788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:28.426993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:28.428509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:28.429678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ce29a609-d790-4be9-858d-f4632785eabf tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.160006 Aug 29 20:19:28.430236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 328/678] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:28 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:28.488253 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:28.489169 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:28.497102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:28.497678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:28.498194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:28.498974 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:28.499550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:28.499985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:28.641961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:28.649925 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2acbddc8-5724-461e-be7f-859ca57288f9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1368 microversion: 2.1 time: 0.167698 Aug 29 20:19:28.650810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 351/679] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:28 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:29.456927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:29.457554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:29.465092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:29.465577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:29.466016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:29.466811 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:29.476089 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:29.476089 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:29.646520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:29.659190 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:29.660858 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:29.662197 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-27ad9fc3-bf45-4915-b88a-8c6a266a36f7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.210601 Aug 29 20:19:29.663062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 329/680] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:29 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:29.678355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:29.678963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:29.686465 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:29.686951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:29.687530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:29.688131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:29.688587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:29.689008 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:29.820560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:29.829507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe1408b0-003b-4ed6-9f67-ae74e7034e39 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1559 microversion: 2.1 time: 0.161181 Aug 29 20:19:29.830077 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 352/681] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:19:29 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:29.849631 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:29.850114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:29.855915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:29.856389 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:29.856966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:29.857841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:29.858401 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:29.858703 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:29.944243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b5cc1b34-bd34-4d50-a548-71bf0a0fbaa6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098312 Aug 29 20:19:29.944878 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 330/682] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:19:29 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:30.686192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:30.686968 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:30.695187 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:30.696159 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:30.696672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:30.698139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:30.698683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:30.699239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:31.112529 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:31.120685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:31.122121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:31.123323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0440cd8-dfba-4b48-b269-34ce9957d226 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.441974 Aug 29 20:19:31.123892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 353/683] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:30 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:31.325045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-4ec4afcf-fdc9-473f-aae1-82f97501cfee req-858acc14-cb37-441d-b492-8cbf43621b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def1c4f2-303e-408b-bd60-188fbcc7e7a4", "tag": "9ebf2957-9ad5-4645-aca0-ad5124e769bb"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:31.336028 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4ec4afcf-fdc9-473f-aae1-82f97501cfee req-858acc14-cb37-441d-b492-8cbf43621b7b service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:31.336610 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4ec4afcf-fdc9-473f-aae1-82f97501cfee req-858acc14-cb37-441d-b492-8cbf43621b7b service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:31.337114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4ec4afcf-fdc9-473f-aae1-82f97501cfee req-858acc14-cb37-441d-b492-8cbf43621b7b service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:31.349793 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-4ec4afcf-fdc9-473f-aae1-82f97501cfee req-858acc14-cb37-441d-b492-8cbf43621b7b service nova] Creating event network-changed:9ebf2957-9ad5-4645-aca0-ad5124e769bb for instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 on hv-cinder-85426 Aug 29 20:19:31.355138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-4ec4afcf-fdc9-473f-aae1-82f97501cfee req-858acc14-cb37-441d-b492-8cbf43621b7b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158187 Aug 29 20:19:31.355932 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 331/684] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:31.966666 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa2bd293-8836-4ff7-a177-d50ccbea6312 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f446cd5fe50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:32.024586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa2bd293-8836-4ff7-a177-d50ccbea6312 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/fd2eea3c-4195-42f7-8002-8e88c1106621" status: 200 len: 350 microversion: 2.1 time: 0.061856 Aug 29 20:19:32.025166 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 354/685] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:19:31 2022] GET /compute/v2.1/os-volumes/fd2eea3c-4195-42f7-8002-8e88c1106621 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:32.149007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:32.149719 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:32.156128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:32.157147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:32.157584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:32.158300 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:32.158757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:32.159410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:32.324306 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:32.343615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:32.343615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:32.343615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-64f596ae-5db2-4e16-992f-b75cf7e67966 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1747 microversion: 2.20 time: 0.194819 Aug 29 20:19:32.344414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 332/686] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:32 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1747 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:33.363492 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:33.364197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:33.378836 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:33.379734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:33.386939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:33.387919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:33.388495 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:33.388992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:33.406038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bae11341-177e-49fb-9b30-5f8912dfa6bf tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f446955db80>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:33.463365 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bae11341-177e-49fb-9b30-5f8912dfa6bf tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/2773c1fb-b19d-4980-a11e-890dde42029c" status: 200 len: 351 microversion: 2.1 time: 0.060988 Aug 29 20:19:33.464298 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 333/687] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:19:33 2022] GET /compute/v2.1/os-volumes/2773c1fb-b19d-4980-a11e-890dde42029c => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:33.555903 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:33.566583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:33.568415 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:33.569842 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b798ca0-1bee-4120-bb17-0a5e2a301e6e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.212422 Aug 29 20:19:33.584016 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 355/688] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:33 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:34.598910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:34.599616 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:34.606656 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:34.607274 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:34.607908 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:34.608827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:34.609649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:34.610092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:34.758860 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:34.768177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:34.769620 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:34.770785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-735d90bb-2561-4e3a-bfd1-b15d31149db7 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.178830 Aug 29 20:19:34.771373 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 334/689] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:34 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:34.906570 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5514645-18a9-4fec-b735-8dd655ffe322 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f44693d4c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:34.961514 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5514645-18a9-4fec-b735-8dd655ffe322 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/0da20f9b-50e0-4dc3-ab3b-98c40b3939d6" status: 200 len: 351 microversion: 2.1 time: 0.058446 Aug 29 20:19:34.963292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 356/690] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:19:34 2022] GET /compute/v2.1/os-volumes/0da20f9b-50e0-4dc3-ab3b-98c40b3939d6 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:34.976289 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9e9bd0cb-fa5f-4652-8a89-bcc44e385794 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f4469499f70>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.064648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9e9bd0cb-fa5f-4652-8a89-bcc44e385794 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092069 Aug 29 20:19:35.065885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 335/691] 10.222.0.121 () {58 vars in 1139 bytes} [Mon Aug 29 20:19:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:19:35.079772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7df0353a-0ce4-4515-b84b-27250989fc2e tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f446cd5e8b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.170120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7df0353a-0ce4-4515-b84b-27250989fc2e tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094716 Aug 29 20:19:35.181319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 357/692] 10.222.0.121 () {58 vars in 1154 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:35.185903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-31863794-9614-468a-8670-f76711232d77 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f44694044c0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.286015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-31863794-9614-468a-8670-f76711232d77 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.103821 Aug 29 20:19:35.286611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 336/693] 10.222.0.121 () {58 vars in 1139 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:35.300174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb83bab0-4308-46f0-84e4-b6e7f1203fe4 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f446ac850d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.393203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb83bab0-4308-46f0-84e4-b6e7f1203fe4 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097016 Aug 29 20:19:35.394071 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 358/694] 10.222.0.121 () {58 vars in 1172 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:35.407568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e9a3285a-bf75-43b8-b8b2-c26241227d6e tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f446940eaf0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.503598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e9a3285a-bf75-43b8-b8b2-c26241227d6e tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.100238 Aug 29 20:19:35.504790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 337/695] 10.222.0.121 () {58 vars in 1175 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:35.517792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b32291a8-d9cc-4009-be05-60996740e26c tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f446cd5fc10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.589499 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-1ce8a1ec-032e-4b58-a013-6ab50fc951fb req-254c9a37-c65a-4eb0-92c0-9d9a5d6870b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2853ad5d-1f93-4b5b-841b-b663e207546e", "name": "network-vif-plugged", "status": "completed", "tag": "96280255-143e-4c45-b633-a728e35130d4"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:35.609038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1ce8a1ec-032e-4b58-a013-6ab50fc951fb req-254c9a37-c65a-4eb0-92c0-9d9a5d6870b5 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:35.610274 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1ce8a1ec-032e-4b58-a013-6ab50fc951fb req-254c9a37-c65a-4eb0-92c0-9d9a5d6870b5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:35.610646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1ce8a1ec-032e-4b58-a013-6ab50fc951fb req-254c9a37-c65a-4eb0-92c0-9d9a5d6870b5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:35.644774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-1ce8a1ec-032e-4b58-a013-6ab50fc951fb req-254c9a37-c65a-4eb0-92c0-9d9a5d6870b5 service nova] Creating event network-vif-plugged:96280255-143e-4c45-b633-a728e35130d4 for instance 2853ad5d-1f93-4b5b-841b-b663e207546e on hv-cinder-85426 Aug 29 20:19:35.650788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-1ce8a1ec-032e-4b58-a013-6ab50fc951fb req-254c9a37-c65a-4eb0-92c0-9d9a5d6870b5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065348 Aug 29 20:19:35.651862 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 338/696] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:19:35.658957 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b32291a8-d9cc-4009-be05-60996740e26c tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.145293 Aug 29 20:19:35.660070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 359/697] 10.222.0.121 () {58 vars in 1160 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:35.684391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c5fd75c4-de8a-41c2-a9a8-4f95342bec2b tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f4469499160>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.783044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c5fd75c4-de8a-41c2-a9a8-4f95342bec2b tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102887 Aug 29 20:19:35.791994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 339/698] 10.222.0.121 () {58 vars in 1193 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:35.797113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d21c0e2-4c43-4900-a1b4-b2e0f99947f3 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] Calling method '.version_select at 0x7f44693d4a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.803051 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:35.804063 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:35.820913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:35.821882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:35.823060 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:35.824844 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:35.825532 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:35.826253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:35.901945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d21c0e2-4c43-4900-a1b4-b2e0f99947f3 tempest-VolumesTestJSON-1223896600 tempest-VolumesTestJSON-1223896600-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.108983 Aug 29 20:19:35.903042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 360/699] 10.222.0.121 () {58 vars in 1160 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:19:36.005627 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:36.014075 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:36.016212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:36.017390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-992c6839-8a4d-4d9e-8357-3db79f2199a8 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.221492 Aug 29 20:19:36.018358 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 340/700] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:35 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:37.047949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:37.048562 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:37.056891 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:37.057648 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:37.058270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:37.058988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:37.059480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:37.059914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:37.223249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:37.233912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:37.236310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:37.237671 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7fc9b1b-ecc4-4bee-a68f-042de48204f5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.194996 Aug 29 20:19:37.238714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 361/701] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:37 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:38.292498 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:38.293589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:38.306303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:38.307277 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:38.307999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:38.308652 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:38.309264 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:38.309846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:38.486764 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:38.498149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:38.500624 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:38.502425 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-585d0a09-45ce-4f99-994c-0905fb097f40 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.213921 Aug 29 20:19:38.503528 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 341/702] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:38 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:39.526441 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:39.527813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:39.536536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:39.537452 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:39.538174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:39.539162 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:39.539965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:39.540591 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:39.714644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:39.729212 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:39.731173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:39.732579 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-950bd0e0-3bd8-41fb-9be4-f74e422a2f66 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.210704 Aug 29 20:19:39.739645 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 362/703] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:39 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:40.757573 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:40.758746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:40.768915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:40.773187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:40.775110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:40.775864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:40.776330 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:40.776759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:40.940374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:40.952353 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:40.953994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:40.955310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-37a0294b-8452-45f7-a897-da694827fd05 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.202538 Aug 29 20:19:40.967689 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 342/704] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:40 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:41.980740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:41.981578 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:41.989165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:41.989778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:41.990395 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:41.991459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:41.992063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:41.992672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:42.144800 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:42.153940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:42.157422 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:42.158931 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01c1824c-9a1e-498c-9c58-0cab11721314 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1742 microversion: 2.20 time: 0.182718 Aug 29 20:19:42.160270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 363/705] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:41 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:43.187900 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:43.188503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:43.195067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:43.195579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:43.196016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:43.196705 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:43.197162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:43.197585 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:43.341026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:43.350640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:43.352103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:43.353291 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6b5a5b78-7693-40bb-ba48-187f0b1189fd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1724 microversion: 2.20 time: 0.170106 Aug 29 20:19:43.353845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 343/706] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:43 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:19:44.376085 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:44.376696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:44.379126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:44.384773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:44.385262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:44.385696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:44.386397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:44.386850 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:44.387300 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:44.516389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:44.524666 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:44.526107 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:44.527284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21070f0f-ad10-406b-9a96-82a533035627 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1724 microversion: 2.20 time: 0.155161 Aug 29 20:19:44.527843 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 364/707] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:44 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:45.550990 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:45.551785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:45.558108 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:45.558586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:45.559015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:45.559728 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:45.560176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:45.560595 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:45.687757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:45.696275 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:45.697699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:45.698844 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d2ebac26-5c5e-421e-bb1e-8336df109153 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1724 microversion: 2.20 time: 0.151746 Aug 29 20:19:45.699423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 344/708] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:45 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:46.722011 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:46.722614 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:46.728936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:46.729410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:46.729843 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:46.730524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:46.730976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:46.731419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:46.864460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:46.872544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:46.873988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:46.875170 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f22b5516-8903-499b-8ee5-c969b0cdd78e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1724 microversion: 2.20 time: 0.157056 Aug 29 20:19:46.875741 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 365/709] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:46 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:47.898477 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:47.899103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:47.901529 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:47.907614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:47.908214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:47.908651 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:47.909377 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:47.909833 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:47.910260 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:48.048661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:48.058951 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:48.060596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:48.062760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-56364a32-6dac-4a69-9462-602bf105bacb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1724 microversion: 2.20 time: 0.167613 Aug 29 20:19:48.063525 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 345/710] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:47 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:48.123309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d4aee713-afa2-4c77-b76a-505448e09723 req-006d1d38-2c3f-4d0b-8160-e2c357e9388d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2853ad5d-1f93-4b5b-841b-b663e207546e", "name": "network-vif-unplugged", "status": "completed", "tag": "96280255-143e-4c45-b633-a728e35130d4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:48.134595 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4aee713-afa2-4c77-b76a-505448e09723 req-006d1d38-2c3f-4d0b-8160-e2c357e9388d service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:48.135156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4aee713-afa2-4c77-b76a-505448e09723 req-006d1d38-2c3f-4d0b-8160-e2c357e9388d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:48.135886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4aee713-afa2-4c77-b76a-505448e09723 req-006d1d38-2c3f-4d0b-8160-e2c357e9388d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:48.157510 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d4aee713-afa2-4c77-b76a-505448e09723 req-006d1d38-2c3f-4d0b-8160-e2c357e9388d service nova] Creating event network-vif-unplugged:96280255-143e-4c45-b633-a728e35130d4 for instance 2853ad5d-1f93-4b5b-841b-b663e207546e on hv-cinder-85426 Aug 29 20:19:48.166619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d4aee713-afa2-4c77-b76a-505448e09723 req-006d1d38-2c3f-4d0b-8160-e2c357e9388d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046600 Aug 29 20:19:48.167883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 366/711] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:19:49.091508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:49.092850 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:49.099780 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.100428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.100866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.101640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.102097 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.102515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.240053 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:49.248148 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:49.250118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:49.251362 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8500e720-f4de-4714-8f45-4e39911fb8a3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1727 microversion: 2.20 time: 0.163605 Aug 29 20:19:49.251888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 346/712] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:49 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:49.275244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e71a4836-f101-4fde-b74e-c90ba8ff9b70"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:49.277618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:49.284709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.285377 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.285817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.286518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.286973 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.287467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.498310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:49.587211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a58b354d-05ba-4f22-b16c-04752c2e0ca3 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316873 Aug 29 20:19:49.587845 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 367/713] 10.222.0.121 () {62 vars in 1369 bytes} [Mon Aug 29 20:19:49 2022] POST /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:49.713095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:49.713588 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:49.719505 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.719986 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.720417 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.721496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:49.721496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:49.722264 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:49.961994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-41ae57a3-fa2e-4a21-b238-353203e9b38d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-volume_attachments/e71a4836-f101-4fde-b74e-c90ba8ff9b70" status: 202 len: 0 microversion: 2.20 time: 0.252718 Aug 29 20:19:49.962591 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 347/714] 10.222.0.121 () {60 vars in 1462 bytes} [Mon Aug 29 20:19:49 2022] DELETE /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-volume_attachments/e71a4836-f101-4fde-b74e-c90ba8ff9b70 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:19:50.021737 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:19:50.022332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:50.028346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:50.028835 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:50.029276 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:50.029970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:50.030919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:50.031377 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:50.073773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120720) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:19:50.139404 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92a91e41-8b86-4a4a-828a-f3908df94603 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "POST /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/action" status: 202 len: 0 microversion: 2.20 time: 0.121735 Aug 29 20:19:50.139976 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 368/715] 10.222.0.121 () {62 vars in 1324 bytes} [Mon Aug 29 20:19:50 2022] POST /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:19:50.148382 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:50.149072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:50.156731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:50.157213 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:50.157672 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:50.158365 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:50.158820 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:50.159354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:50.290003 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:50.298508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:50.300110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:50.301285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-41fed63e-c771-4f7c-abe0-7cc20ddf372d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1675 microversion: 2.20 time: 0.157084 Aug 29 20:19:50.301864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 348/716] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:50 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:19:51.324573 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:51.325229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:51.331463 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:51.331956 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:51.332420 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:51.333126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:51.333586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:51.334043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:51.468245 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:51.476587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:51.478013 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:51.479181 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-902a80f8-124a-4153-bd7f-7bf350bd6461 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1677 microversion: 2.20 time: 0.159131 Aug 29 20:19:51.479728 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 369/717] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:51 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:52.503442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:52.504102 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:52.511561 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:52.512054 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:52.512485 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:52.513208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:52.513680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:52.514092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:52.708151 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:52.714549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:52.718247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:52.719963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:52.721355 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-00d072d9-bf4c-4f02-9078-3f60726c219e tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.222468 Aug 29 20:19:52.723118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 349/718] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:52 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:53.749169 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:53.750065 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:53.758290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:53.759030 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:53.759673 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:53.760667 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:53.761327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:53.761915 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:53.916492 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:53.926024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:53.930819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:53.930819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8e4ec4d5-444c-46cd-b75e-6fda25adf85d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.186323 Aug 29 20:19:53.930819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 370/719] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:53 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:54.953392 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:54.953914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:54.961726 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:54.962479 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:54.963093 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:54.963993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:54.964608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:54.965192 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:55.125078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:55.135535 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:55.137205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:55.138560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2bf87228-7278-4ca9-b79b-9c2367411ab5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.190074 Aug 29 20:19:55.140189 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 350/720] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:54 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:56.162676 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:56.163530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:56.171164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:56.171656 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:56.172102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:56.172805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:56.173258 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:56.173683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:56.308549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:56.317984 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:56.319559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:56.320732 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fef52b0c-7821-4516-a364-7a3e9ef9e90a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.162051 Aug 29 20:19:56.321529 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 371/721] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:56 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:57.345852 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:57.346676 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:57.353387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:57.353978 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:57.354545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:57.355352 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:57.355878 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:57.356409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:57.489788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:57.498071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:57.500133 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:57.501295 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e21b9c54-ed78-4279-9e93-1ce4cf4c4f14 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.159442 Aug 29 20:19:57.501944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 351/722] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:57 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:58.526296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:58.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:58.534907 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:58.535420 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:58.535849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:58.536541 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:58.537201 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:58.537642 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:58.687119 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:58.697417 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:58.698946 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:58.700254 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd03b20c-6496-4d50-a21d-660d74085352 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.178015 Aug 29 20:19:58.700922 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 372/723] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:58 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:19:59.723181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:19:59.723836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:19:59.733423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:59.733987 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:59.734486 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:59.735230 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:19:59.735758 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:19:59.736183 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:19:59.882878 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:59.892448 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:59.894045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:19:59.895387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c056155b-0bfb-4e55-9132-361cb1aa5708 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.176208 Aug 29 20:19:59.896317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 352/724] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:19:59 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:00.920977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:00.921693 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:00.934339 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:00.935102 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:00.935901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:00.938086 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:00.939072 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:00.939415 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:01.093197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:01.101472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:01.102911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:01.104123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13a18bde-3e16-4af2-9194-d1ddc5e179a0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.187772 Aug 29 20:20:01.104727 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 373/725] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:00 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:02.129787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:02.130402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:02.141691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:02.141691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:02.141691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:02.141691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:02.142069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:02.142069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:02.277346 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:02.285533 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:02.286968 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:02.288143 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-75cf60d5-dc74-451b-9673-0f8d623075eb tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.164059 Aug 29 20:20:02.288687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 353/726] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:02 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:03.311445 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:03.312040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:03.318742 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:03.319272 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:03.319706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:03.320392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:03.320845 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:03.321261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:03.458926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:03.470420 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:03.472016 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:03.473263 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21864bb5-2fce-4011-9a26-4f36c293198b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.166162 Aug 29 20:20:03.473982 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 374/727] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:03 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:04.496838 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:04.497443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:04.504550 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:04.505031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:04.505471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:04.506164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:04.506614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:04.507031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:04.635697 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:04.643608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:04.645034 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:04.646419 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a9d59d00-0512-48a6-951c-dc2e3e5558ff tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.153540 Aug 29 20:20:04.646977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 354/728] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:04 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:05.669044 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:05.669651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:05.677156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:05.677651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:05.678082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:05.678812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:05.679300 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:05.679733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:05.809204 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:05.817302 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:05.818740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:05.819918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0cbb4c1b-bd00-44d3-8361-ae601ac8bfd1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.154783 Aug 29 20:20:05.820485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 375/729] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:05 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:06.185953 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-7ad97759-742c-4c9f-badf-306b9e5cd429 req-6ad16948-cc29-456b-896a-b27d4e8889d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2853ad5d-1f93-4b5b-841b-b663e207546e", "name": "network-vif-plugged", "status": "completed", "tag": "96280255-143e-4c45-b633-a728e35130d4"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:06.198833 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-7ad97759-742c-4c9f-badf-306b9e5cd429 req-6ad16948-cc29-456b-896a-b27d4e8889d2 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:06.199421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-7ad97759-742c-4c9f-badf-306b9e5cd429 req-6ad16948-cc29-456b-896a-b27d4e8889d2 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:06.200050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-7ad97759-742c-4c9f-badf-306b9e5cd429 req-6ad16948-cc29-456b-896a-b27d4e8889d2 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:06.212214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-7ad97759-742c-4c9f-badf-306b9e5cd429 req-6ad16948-cc29-456b-896a-b27d4e8889d2 service nova] Creating event network-vif-plugged:96280255-143e-4c45-b633-a728e35130d4 for instance 2853ad5d-1f93-4b5b-841b-b663e207546e on hv-cinder-85426 Aug 29 20:20:06.217322 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-7ad97759-742c-4c9f-badf-306b9e5cd429 req-6ad16948-cc29-456b-896a-b27d4e8889d2 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Aug 29 20:20:06.217915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 355/730] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:06.842707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:06.843332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:06.850660 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:06.851175 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:06.851606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:06.852601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:06.853051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:06.853471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:06.986234 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:06.994257 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:06.995725 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:06.996862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f382c7be-bb31-4438-9b0f-dde76d30573d tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.158122 Aug 29 20:20:06.997423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 376/731] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:06 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:08.021679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:08.022379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:08.028454 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:08.028936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:08.029371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:08.030057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:08.030512 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:08.030934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:08.158735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:08.166897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:08.168360 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:08.169537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-48e987ba-1210-4118-b1e8-79387e70e02f tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.153500 Aug 29 20:20:08.170088 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 356/732] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:08 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:09.194206 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:09.194840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:09.201332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:09.201817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:09.202250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:09.202940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:09.203904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:09.204412 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:09.342959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:09.351282 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:09.352729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:09.353895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3101d558-1e2b-4435-8f11-9073b14812d9 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1733 microversion: 2.20 time: 0.163575 Aug 29 20:20:09.354463 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 377/733] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:09 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:10.378421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:10.379257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:10.386302 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:10.386906 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:10.387405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:10.388130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:10.388579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:10.389000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:10.521579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:10.529698 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:10.531174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:10.532356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5cb845ec-c9f9-4dda-86f9-42e1baa635c1 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1720 microversion: 2.20 time: 0.159081 Aug 29 20:20:10.533179 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 357/734] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:10 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:15.050262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:15.050829 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:15.053177 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:15.058382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.058864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.059331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.060022 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:15.060475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:15.060901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:15.085627 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4e8ecb1-8055-4b0b-82e3-e1f9128a116c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/ips" status: 200 len: 149 microversion: 2.1 time: 0.039229 Aug 29 20:20:15.086191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 378/735] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:20:15 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:18.523843 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b94061f-e045-47cc-9d14-ef10152a29dc"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:18.526791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:18.529299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=26 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:18.534586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:18.535119 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:18.535574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:18.536467 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:18.536924 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:18.537344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:18.809792 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d1b36c28-8574-46fc-9db9-fd49aaf6349d tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "POST /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290864 Aug 29 20:20:18.810429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 358/736] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:20:18 2022] POST /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:29.631939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:29.632438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:29.634456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:29.635115 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:29.640895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.641375 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.641813 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.642509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.642967 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.643420 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.728570 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lazy-loading 'services' on Instance uuid def1c4f2-303e-408b-bd60-188fbcc7e7a4 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:20:29.802159 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e055fce4-9002-44f8-b026-e03e85f19fd9 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments/6b94061f-e045-47cc-9d14-ef10152a29dc" status: 202 len: 0 microversion: 2.1 time: 0.174183 Aug 29 20:20:29.805897 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 379/737] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:20:29 2022] DELETE /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments/6b94061f-e045-47cc-9d14-ef10152a29dc => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:29.809210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:29.810507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:29.816511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:29.819122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:29.826842 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.827366 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.827811 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.828506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:29.828965 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:29.829388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:29.863396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-823756a0-ce83-42c3-8f32-7f704177d0d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055871 Aug 29 20:20:29.864046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 359/738] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:20:29 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:30.877608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:30.879910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:30.886351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:30.886837 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:30.887314 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:30.888022 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:30.888480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:30.888912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:30.919281 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48fcfddd-fa00-4d90-adfe-f2a6c780a9fb tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Aug 29 20:20:30.919855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 380/739] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:20:30 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:31.931373 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:31.933536 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:31.940087 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:31.940565 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:31.940997 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:31.941683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:31.942138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:31.943061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:31.973998 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f8ab4239-79a7-4f1e-b504-2bf799973b1e tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046593 Aug 29 20:20:31.974555 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 360/740] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:20:31 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:32.986292 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:32.988447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:32.995721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.996201 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.996637 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:32.997324 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:32.997775 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:32.998193 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:33.028412 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5bab7a4-d560-4c5b-9dcc-1ca88f1b0d8c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Aug 29 20:20:33.029003 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 381/741] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:20:32 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:34.040946 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:34.043099 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:34.049819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.050303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.050742 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.051469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.051951 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.052381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.082699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-21f57f1c-7a47-4c6d-b6e5-b2d19e258fea tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045699 Aug 29 20:20:34.083926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 361/742] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:20:34 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:20:34.153678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:34.154203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:34.160502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.161017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.161595 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.162293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.162748 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.163193 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.188761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:20:34.270928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80881649-ae11-401d-aedf-09c6c7145205 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 204 len: 0 microversion: 2.1 time: 0.120201 Aug 29 20:20:34.272051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 382/743] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:20:34 2022] DELETE /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:20:34.280152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:34.280787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:34.286758 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.287392 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.287837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.288531 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:34.288994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:34.289424 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:34.427344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:34.435026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b2e24243-751a-428a-b086-7a5c65839dc2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1682 microversion: 2.1 time: 0.158777 Aug 29 20:20:34.435622 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 362/744] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:34 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:35.457823 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:35.459310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:35.467928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:35.468483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:35.469067 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:35.469838 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:35.470295 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:35.470726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:35.606456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:35.614438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65fc77a1-a381-4431-a09e-23e734e246c7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1682 microversion: 2.1 time: 0.161467 Aug 29 20:20:35.615006 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 383/745] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:35 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:36.635481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:36.636085 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:36.642653 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:36.643164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:36.643601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:36.644545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:36.645003 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:36.645481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:36.771015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:36.778596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a2e2f787-4f83-4977-aa39-c0801e1adcb1 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1682 microversion: 2.1 time: 0.146906 Aug 29 20:20:36.779175 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 363/746] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:36 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:37.798661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:37.799260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:37.806699 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:37.807213 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:37.807645 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:37.808326 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:37.808780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:37.809198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:37.946345 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:37.954173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4effffb6-86b6-4a81-adb6-b3b641f96896 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1682 microversion: 2.1 time: 0.159572 Aug 29 20:20:37.954746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 384/747] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:37 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:38.976424 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:38.977204 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:38.983644 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:38.984128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:38.984564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:38.985317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:38.985876 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:38.986303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:39.120787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:39.129835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1251d41a-9de3-4e7f-80ed-a7e713b2e5d8 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1682 microversion: 2.1 time: 0.157849 Aug 29 20:20:39.130952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 364/748] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:38 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:39.791913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1cf791ac-aaca-4ecc-ab40-131ecd0c076f req-3025f971-f35e-41ab-8666-4ed660d5f706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def1c4f2-303e-408b-bd60-188fbcc7e7a4", "name": "network-vif-deleted", "tag": "9ebf2957-9ad5-4645-aca0-ad5124e769bb"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:39.802198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1cf791ac-aaca-4ecc-ab40-131ecd0c076f req-3025f971-f35e-41ab-8666-4ed660d5f706 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:39.802780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1cf791ac-aaca-4ecc-ab40-131ecd0c076f req-3025f971-f35e-41ab-8666-4ed660d5f706 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:39.803308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1cf791ac-aaca-4ecc-ab40-131ecd0c076f req-3025f971-f35e-41ab-8666-4ed660d5f706 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:39.814475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1cf791ac-aaca-4ecc-ab40-131ecd0c076f req-3025f971-f35e-41ab-8666-4ed660d5f706 service nova] Creating event network-vif-deleted:9ebf2957-9ad5-4645-aca0-ad5124e769bb for instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 on hv-cinder-85426 Aug 29 20:20:39.820131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1cf791ac-aaca-4ecc-ab40-131ecd0c076f req-3025f971-f35e-41ab-8666-4ed660d5f706 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032127 Aug 29 20:20:39.820981 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 385/749] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:40.152344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:40.152958 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:40.159646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:40.160118 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:40.160553 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:40.161256 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:40.162219 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:40.162641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:40.194187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:40.194676 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:40.195141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:40.195591 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lazy-loading 'fault' on Instance uuid def1c4f2-303e-408b-bd60-188fbcc7e7a4 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:20:40.236884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d284a41f9b4326a99c6a59a2f0c290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67fdb2b34644659a8054ecf10999cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:40.244617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a3c06229-220e-41c2-9f4a-9ce8e76e16d2 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 200 len: 1333 microversion: 2.1 time: 0.096130 Aug 29 20:20:40.245191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 365/750] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:40 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:41.266205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:41.266907 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:41.273367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:41.273850 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:41.274287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:41.274978 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:41.275460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:41.275884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:41.290773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 HTTP/1.1 Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:41.292588 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:41.294164 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'def1c4f2-303e-408b-bd60-188fbcc7e7a4'} Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:41.295244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:41.296700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:41.298259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:41.298259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07c9be75-37b1-4eb7-954f-21bfad3dcbd7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 404 len: 111 microversion: 2.1 time: 0.032405 Aug 29 20:20:41.298259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 386/751] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:41 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:41.303963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bd2957cb-fdef-48d5-add7-ff38de776d0c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '.version_select at 0x7f446940e0d0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:41.323378 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bd2957cb-fdef-48d5-add7-ff38de776d0c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300913440" status: 202 len: 0 microversion: 2.1 time: 0.023637 Aug 29 20:20:41.323937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 366/752] 10.222.0.121 () {58 vars in 1223 bytes} [Mon Aug 29 20:20:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300913440 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:43.033180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:43.034239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:43.040435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.040928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.041372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.042077 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.042537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.042965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.056641 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 HTTP/1.1 Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:43.058203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.059802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'def1c4f2-303e-408b-bd60-188fbcc7e7a4'} Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:43.060560 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.061892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.063287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:43.063287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e701c60-1e47-4bf7-8e84-fe3b857f6edc tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 404 len: 111 microversion: 2.1 time: 0.030294 Aug 29 20:20:43.063287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 387/753] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:20:43 2022] DELETE /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:43.068593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:43.069206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: def1c4f2-303e-408b-bd60-188fbcc7e7a4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:43.076157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.076643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.077262 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.077949 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:43.078407 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:43.078833 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:43.092724 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 HTTP/1.1 Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:20:43.094680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.096243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': 'def1c4f2-303e-408b-bd60-188fbcc7e7a4'} Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:43.097158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. Aug 29 20:20:43.098769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:43.100177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance def1c4f2-303e-408b-bd60-188fbcc7e7a4 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:43.100177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-af0a9c63-4b29-493b-a331-02ca884fe770 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4" status: 404 len: 111 microversion: 2.1 time: 0.032642 Aug 29 20:20:43.100177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 367/754] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:43 2022] GET /compute/v2.1/servers/def1c4f2-303e-408b-bd60-188fbcc7e7a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:20:44.242358 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.242890 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:44.248950 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.249434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.249872 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.250571 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.251027 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.251654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.265940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 HTTP/1.1 Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:44.267502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.269287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '4c624a0f-156c-4f96-b9f9-a418c1a47066'} Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:44.273275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.274672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.276112 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:44.276112 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dff44cbc-dcce-4430-8021-67e3ef378ac7 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 404 len: 111 microversion: 2.1 time: 0.031422 Aug 29 20:20:44.276112 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 388/755] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:20:44 2022] DELETE /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:44.277644 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.278259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 4c624a0f-156c-4f96-b9f9-a418c1a47066] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:44.285510 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.285996 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.286427 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.287179 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.287634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.288055 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.303425 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 HTTP/1.1 Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:20:44.304952 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.306215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '4c624a0f-156c-4f96-b9f9-a418c1a47066'} Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:44.306984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. Aug 29 20:20:44.308611 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.309625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance 4c624a0f-156c-4f96-b9f9-a418c1a47066 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:44.309625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c4ab4047-70e4-4e93-8322-2eb5c5b692f6 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066" status: 404 len: 111 microversion: 2.1 time: 0.032449 Aug 29 20:20:44.309625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 368/756] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:44 2022] GET /compute/v2.1/servers/4c624a0f-156c-4f96-b9f9-a418c1a47066 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:44.315110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.315609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:44.322286 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.322882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.323249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.323951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.324413 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.324871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.341347 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 HTTP/1.1 Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:44.343126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.344761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '34ce8543-4378-4a6f-b1ce-c98e6321ec59'} Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:44.345629 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.347018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.348565 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:44.348565 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cf7c5183-8b61-420a-a344-d8c5ccc3d35c tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 404 len: 111 microversion: 2.1 time: 0.033194 Aug 29 20:20:44.348565 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 389/757] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:20:44 2022] DELETE /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:20:44.354040 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:44.354882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: 34ce8543-4378-4a6f-b1ce-c98e6321ec59] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:44.361057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.361705 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.362185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.363139 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:44.363633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:44.364061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:44.381280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 HTTP/1.1 Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:20:44.382999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.384336 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '34ce8543-4378-4a6f-b1ce-c98e6321ec59'} Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:44.385032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. Aug 29 20:20:44.386174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:44.387240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance 34ce8543-4378-4a6f-b1ce-c98e6321ec59 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:44.387240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-517fb557-3b35-436c-b0e4-73a1642bc610 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59" status: 404 len: 111 microversion: 2.1 time: 0.035310 Aug 29 20:20:44.387240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 369/758] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:44 2022] GET /compute/v2.1/servers/34ce8543-4378-4a6f-b1ce-c98e6321ec59 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:45.564849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.565555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:45.573121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.573613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.574046 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:45.575050 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.575800 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.576411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:45.591802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c HTTP/1.1 Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:45.593443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.594963 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'a078027c-0fda-486c-9f40-ac527c610a4c'} Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:45.595878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.597308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.598685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:45.598685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76e8eb89-776a-4f9f-b159-e27b9be7853a tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 404 len: 111 microversion: 2.1 time: 0.033876 Aug 29 20:20:45.598685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 390/759] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:20:45 2022] DELETE /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:20:45.604313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:45.604925 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] [instance: a078027c-0fda-486c-9f40-ac527c610a4c] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:45.611227 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.611711 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.612146 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:45.612835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:45.613273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:45.613693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:45.627367 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] HTTP exception thrown: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Request method failure captured: Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c HTTP/1.1 Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR38pilZIgs-MagwCG-ycYLKymJSnf7UVqbZIro3ILN7sfWboHZFCVBUiSChHQQeK5HNPWFgHCp2i_wWeDQsK0KeztlvESI4Xhvpaxz8Xto4n8tE2Rw_nglNdEKRgNL5OWk19ERU57-4Gnzc0idsPxV4QwoAM4Y5lRLfUXdXZJC8WIU Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:20:45.628888 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9d67fdb2b34644659a8054ecf10999cc", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9d67fdb2b34644659a8054ecf10999cc"}]}] Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 9d67fdb2b34644659a8054ecf10999cc Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2113943219 Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: c0d284a41f9b4326a99c6a59a2f0c290 Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeNegativeTest-2113943219-project Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.630442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': 'a078027c-0fda-486c-9f40-ac527c610a4c'} Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:45.631325 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. Aug 29 20:20:45.632530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:45.633554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] Returning 404 to user: Instance a078027c-0fda-486c-9f40-ac527c610a4c could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:45.633554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1423e367-a27a-4085-a73f-73e409c27910 tempest-AttachVolumeNegativeTest-2113943219 tempest-AttachVolumeNegativeTest-2113943219-project] 10.222.0.121 "GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c" status: 404 len: 111 microversion: 2.1 time: 0.029836 Aug 29 20:20:45.633554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 370/760] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:20:45 2022] GET /compute/v2.1/servers/a078027c-0fda-486c-9f40-ac527c610a4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:20:50.769929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3948b9ab-da39-403a-8a07-f9079c07a4b4 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Action: 'create', calling method: .version_select at 0x7f446cd6edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-542400343", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:51.083226 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3948b9ab-da39-403a-8a07-f9079c07a4b4 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.449914 Aug 29 20:20:51.083861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 391/761] 10.222.0.121 () {60 vars in 1161 bytes} [Mon Aug 29 20:20:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 451 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 29 20:20:51.097401 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-beeca1a0-bc60-4722-8e37-9c0d0663afc3 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Calling method '.version_select at 0x7f4469378af0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.146704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-beeca1a0-bc60-4722-8e37-9c0d0663afc3 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575" status: 200 len: 352 microversion: 2.1 time: 0.054104 Aug 29 20:20:51.147387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 371/762] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:51.529920 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.532055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:51.538988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.539505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.539938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:51.540648 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.541105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.541527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:51.570218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-990ab15f-199c-4314-b27e-8e82f545938b tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044266 Aug 29 20:20:51.570762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 392/763] 10.222.0.121 () {60 vars in 1348 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:20:51.631317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.631819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:51.637759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.638242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.638677 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:51.639406 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.639874 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.640295 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:51.665277 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:20:51.742892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-172179b3-b7eb-4dad-8ed7-bd8f699b932a tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 204 len: 0 microversion: 2.20 time: 0.115820 Aug 29 20:20:51.743613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 372/764] 10.222.0.121 () {60 vars in 1285 bytes} [Mon Aug 29 20:20:51 2022] DELETE /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:20:51.751660 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:51.752366 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:51.758965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.759490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.759930 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:51.760635 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:51.761096 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:51.761523 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:52.072940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:52.081533 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:52.083273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:52.084817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bccd61c3-5ecb-4cc3-80a7-dd374988cfb6 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.337060 Aug 29 20:20:52.085380 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 393/765] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:51 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:52.161772 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-afddaddb-410b-4e69-bfaa-2e8f85b9a5f7 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Calling method '.version_select at 0x7f446940e550>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:52.210798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-afddaddb-410b-4e69-bfaa-2e8f85b9a5f7 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575" status: 200 len: 353 microversion: 2.1 time: 0.054147 Aug 29 20:20:52.211396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 373/766] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:20:52 2022] GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:52.224614 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1021a87-96dd-4178-b131-2cd26a2b20e9 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Calling method '.version_select at 0x7f446940fb80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:52.273866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1021a87-96dd-4178-b131-2cd26a2b20e9 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575" status: 200 len: 353 microversion: 2.1 time: 0.053770 Aug 29 20:20:52.274433 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 394/767] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:20:52 2022] GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:52.291942 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-038f16e4-51ef-4ba7-b581-85df9848a1b4 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Calling method '.version_select at 0x7f44693d0d30>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:52.354405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-038f16e4-51ef-4ba7-b581-85df9848a1b4 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575" status: 202 len: 0 microversion: 2.1 time: 0.066138 Aug 29 20:20:52.354968 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 374/768] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:20:52 2022] DELETE /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:20:52.363852 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c361baa-487e-419e-8b0d-de370acf1a1a tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Calling method '.version_select at 0x7f446cd499d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:52.415135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c361baa-487e-419e-8b0d-de370acf1a1a tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575" status: 200 len: 352 microversion: 2.1 time: 0.055330 Aug 29 20:20:52.415738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 395/769] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:20:52 2022] GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:53.108756 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:53.109539 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:53.115499 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:53.115984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:53.116460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:53.117090 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:53.117558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:53.117955 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:53.255894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:53.264803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:53.266235 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:53.267464 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b331bef0-2fd7-4b04-accc-3196dd3175ee tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1726 microversion: 2.20 time: 0.162581 Aug 29 20:20:53.269128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 375/770] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:53 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:53.431534 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6cb4f7d5-39d0-48a1-9e89-e2b6a7020882 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Calling method '.version_select at 0x7f446cd1e9d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:53.462970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6cb4f7d5-39d0-48a1-9e89-e2b6a7020882 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] HTTP exception thrown: Volume 955a0e9d-2433-48e5-b8f0-de5134041575 could not be found. Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6cb4f7d5-39d0-48a1-9e89-e2b6a7020882 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Request method failure captured: Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575 HTTP/1.1 Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR-ih8cYkmSquGnDvTqDLlGf1AWZxvzyX4L3Z3pjUoweQkgWBfP1zwunHfTuAlX4lPNk9kAfH2hs09IHNqOH1szYTKYf-KGffycqlto2GfmWHiFGaQnXtd4z74svkcaPQtXf3bUHMB0JSHbh3fBdJQan80TEjsDVhe9Jik84Gro5GPc Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 0170de11535843c79514cde22efbd4c3 Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesGetTestJSON-11054588 Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:53.464993 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/0170de11535843c79514cde22efbd4c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/0170de11535843c79514cde22efbd4c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_0170de11535843c79514cde22efbd4c3", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/0170de11535843c79514cde22efbd4c3"}]}] Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesGetTestJSON-11054588 Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0170de11535843c79514cde22efbd4c3 Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesGetTestJSON-11054588 Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesGetTestJSON-11054588-project Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 7d4c4bd7a1f94b4f870ec63665bf73be Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesGetTestJSON-11054588-project Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Volume 955a0e9d-2433-48e5-b8f0-de5134041575 could not be found. Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '955a0e9d-2433-48e5-b8f0-de5134041575'} Aug 29 20:20:53.466299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 955a0e9d-2433-48e5-b8f0-de5134041575 could not be found. (HTTP 404) (Request-ID: req-45624a86-c68a-407a-a697-88989d5f6dd3) Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:53.467368 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:20:53.468625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 955a0e9d-2433-48e5-b8f0-de5134041575 could not be found. Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:20:53.469720 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 955a0e9d-2433-48e5-b8f0-de5134041575 could not be found. Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 955a0e9d-2433-48e5-b8f0-de5134041575 could not be found. Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6cb4f7d5-39d0-48a1-9e89-e2b6a7020882 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] Returning 404 to user: Volume 955a0e9d-2433-48e5-b8f0-de5134041575 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6cb4f7d5-39d0-48a1-9e89-e2b6a7020882 tempest-VolumesGetTestJSON-11054588 tempest-VolumesGetTestJSON-11054588-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575" status: 404 len: 109 microversion: 2.1 time: 0.041154 Aug 29 20:20:53.470798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 396/771] 10.222.0.121 () {58 vars in 1250 bytes} [Mon Aug 29 20:20:53 2022] GET /compute/v2.1/os-volumes/955a0e9d-2433-48e5-b8f0-de5134041575 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:54.221160 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-21e7a485-c5fb-4982-973b-391e0433e215 req-ff31f8a3-80d7-4850-9064-d01ffb02d227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2853ad5d-1f93-4b5b-841b-b663e207546e", "name": "network-vif-deleted", "tag": "96280255-143e-4c45-b633-a728e35130d4"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:20:54.244052 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-21e7a485-c5fb-4982-973b-391e0433e215 req-ff31f8a3-80d7-4850-9064-d01ffb02d227 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:54.244997 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-21e7a485-c5fb-4982-973b-391e0433e215 req-ff31f8a3-80d7-4850-9064-d01ffb02d227 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:54.245645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-21e7a485-c5fb-4982-973b-391e0433e215 req-ff31f8a3-80d7-4850-9064-d01ffb02d227 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:54.260991 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-21e7a485-c5fb-4982-973b-391e0433e215 req-ff31f8a3-80d7-4850-9064-d01ffb02d227 service nova] Creating event network-vif-deleted:96280255-143e-4c45-b633-a728e35130d4 for instance 2853ad5d-1f93-4b5b-841b-b663e207546e on hv-cinder-85426 Aug 29 20:20:54.293914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-21e7a485-c5fb-4982-973b-391e0433e215 req-ff31f8a3-80d7-4850-9064-d01ffb02d227 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083370 Aug 29 20:20:54.295279 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 376/772] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:20:54.303666 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:54.304418 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:54.327175 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:54.337266 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:54.340585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:54.343110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:54.343793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:54.345369 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:54.436904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:54.437571 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:54.437806 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:54.438438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lazy-loading 'fault' on Instance uuid 2853ad5d-1f93-4b5b-841b-b663e207546e {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:20:54.511838 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:54.543248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:54.544779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ce1e14c83aa47c184750585f941ecb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f374198d34097b4deee456a3b3be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:20:54.546559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e59d657-4326-44ae-a18c-ea4946adac02 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 200 len: 1375 microversion: 2.20 time: 0.256885 Aug 29 20:20:54.559761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 397/773] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:54 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 1375 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:20:55.572869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:55.573567 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:55.580313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:55.580993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:55.581545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:55.582324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:55.582944 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:55.583416 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:55.596954 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] HTTP exception thrown: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Request method failure captured: Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e HTTP/1.1 Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR32-e9MNLhZ1oDUqDcicgHfw1nbkGVqg7ViGKYn8x8reV7cAZyq_qLlzjNSpUO2wfbVDf1ztF93bXokAM_HwX170_e7tgk6npx0oOjgbTTwOn4z114py_T0HCYbChdC8rpdpXsMp7LmLTS6VvJEj1CZeVGWdgTDUxfTsaUO0wCLgTU Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:20:55.599057 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7f8f374198d34097b4deee456a3b3be7", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}] Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 7ce1e14c83aa47c184750585f941ecb0 Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:55.600614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '2853ad5d-1f93-4b5b-841b-b663e207546e'} Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:55.604670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:55.606397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:55.607924 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Returning 404 to user: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:55.607924 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-72db0d29-3476-4717-88e9-2444e39221c0 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 404 len: 111 microversion: 2.20 time: 0.031850 Aug 29 20:20:55.607924 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 377/774] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:55 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:20:55.609542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd511de4-c0f5-430e-8f96-f26068b37919 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '.version_select at 0x7f446940fb80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:55.629643 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd511de4-c0f5-430e-8f96-f26068b37919 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-537243794" status: 204 len: 0 microversion: 2.20 time: 0.024195 Aug 29 20:20:55.630218 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 398/775] 10.222.0.121 () {60 vars in 1264 bytes} [Mon Aug 29 20:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-537243794 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:20:57.458992 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:57.459557 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:57.466113 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:57.466701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:57.467203 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:57.467897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:57.468398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:57.468808 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:57.483159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] HTTP exception thrown: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Request method failure captured: Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: DELETE /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e HTTP/1.1 Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR32-e9MNLhZ1oDUqDcicgHfw1nbkGVqg7ViGKYn8x8reV7cAZyq_qLlzjNSpUO2wfbVDf1ztF93bXokAM_HwX170_e7tgk6npx0oOjgbTTwOn4z114py_T0HCYbChdC8rpdpXsMp7LmLTS6VvJEj1CZeVGWdgTDUxfTsaUO0wCLgTU Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:20:57.484898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7f8f374198d34097b4deee456a3b3be7", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}] Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 7ce1e14c83aa47c184750585f941ecb0 Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.486221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '2853ad5d-1f93-4b5b-841b-b663e207546e'} Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:57.487211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.489095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.491120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Returning 404 to user: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:57.491120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b8739b60-6dd9-44de-9637-55581b31e3a5 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 404 len: 111 microversion: 2.20 time: 0.031801 Aug 29 20:20:57.491120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 378/776] 10.222.0.121 () {60 vars in 1285 bytes} [Mon Aug 29 20:20:57 2022] DELETE /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:20:57.496194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:57.496950 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2853ad5d-1f93-4b5b-841b-b663e207546e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:57.505540 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:57.506127 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:57.506621 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:57.507522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:57.510824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:57.510824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:57.525732 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] HTTP exception thrown: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Request method failure captured: Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e HTTP/1.1 Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR32-e9MNLhZ1oDUqDcicgHfw1nbkGVqg7ViGKYn8x8reV7cAZyq_qLlzjNSpUO2wfbVDf1ztF93bXokAM_HwX170_e7tgk6npx0oOjgbTTwOn4z114py_T0HCYbChdC8rpdpXsMp7LmLTS6VvJEj1CZeVGWdgTDUxfTsaUO0wCLgTU Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:57.527308 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7f8f374198d34097b4deee456a3b3be7", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}] Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 7ce1e14c83aa47c184750585f941ecb0 Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.528879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '2853ad5d-1f93-4b5b-841b-b663e207546e'} Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:57.531948 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. Aug 29 20:20:57.534053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:57.535424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Returning 404 to user: Instance 2853ad5d-1f93-4b5b-841b-b663e207546e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:57.535424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a25fe857-c05b-4225-9346-47db130c6459 tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e" status: 404 len: 111 microversion: 2.20 time: 0.036727 Aug 29 20:20:57.535424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 399/777] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:57 2022] GET /compute/v2.1/servers/2853ad5d-1f93-4b5b-841b-b663e207546e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:20:58.682591 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:58.683151 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:58.689832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:58.690327 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:58.690759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:58.691493 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:58.692486 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:58.693194 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:58.707127 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] HTTP exception thrown: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Request method failure captured: Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: DELETE /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe HTTP/1.1 Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR32-e9MNLhZ1oDUqDcicgHfw1nbkGVqg7ViGKYn8x8reV7cAZyq_qLlzjNSpUO2wfbVDf1ztF93bXokAM_HwX170_e7tgk6npx0oOjgbTTwOn4z114py_T0HCYbChdC8rpdpXsMp7LmLTS6VvJEj1CZeVGWdgTDUxfTsaUO0wCLgTU Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:20:58.709371 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7f8f374198d34097b4deee456a3b3be7", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}] Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 7ce1e14c83aa47c184750585f941ecb0 Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.710816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '2ee34ea9-ae27-4156-8f42-17d06286bebe'} Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:58.711560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.712885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.714084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Returning 404 to user: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:58.714084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-35c90a6a-0a75-4d52-b122-e352b6dea7bd tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "DELETE /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 404 len: 111 microversion: 2.20 time: 0.032041 Aug 29 20:20:58.714084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 379/778] 10.222.0.121 () {60 vars in 1285 bytes} [Mon Aug 29 20:20:58 2022] DELETE /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:20:58.719416 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:20:58.720029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] [instance: 2ee34ea9-ae27-4156-8f42-17d06286bebe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:20:58.726669 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:58.727196 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:58.727719 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:58.728325 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:20:58.728784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:20:58.729206 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:20:58.743936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] HTTP exception thrown: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Request method failure captured: Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe HTTP/1.1 Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR32-e9MNLhZ1oDUqDcicgHfw1nbkGVqg7ViGKYn8x8reV7cAZyq_qLlzjNSpUO2wfbVDf1ztF93bXokAM_HwX170_e7tgk6npx0oOjgbTTwOn4z114py_T0HCYbChdC8rpdpXsMp7LmLTS6VvJEj1CZeVGWdgTDUxfTsaUO0wCLgTU Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:20:58.745625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7f8f374198d34097b4deee456a3b3be7", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7f8f374198d34097b4deee456a3b3be7"}]}] Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 7f8f374198d34097b4deee456a3b3be7 Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-195064812 Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 7ce1e14c83aa47c184750585f941ecb0 Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-195064812-project Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.747132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '2ee34ea9-ae27-4156-8f42-17d06286bebe'} Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:20:58.748171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. Aug 29 20:20:58.749421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:20:58.750485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] Returning 404 to user: Instance 2ee34ea9-ae27-4156-8f42-17d06286bebe could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:20:58.750485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4893ea55-97b7-4711-9abd-39d549503ade tempest-AttachVolumeShelveTestJSON-195064812 tempest-AttachVolumeShelveTestJSON-195064812-project] 10.222.0.121 "GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe" status: 404 len: 111 microversion: 2.20 time: 0.031569 Aug 29 20:20:58.750485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 400/779] 10.222.0.121 () {60 vars in 1282 bytes} [Mon Aug 29 20:20:58 2022] GET /compute/v2.1/servers/2ee34ea9-ae27-4156-8f42-17d06286bebe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:21:06.585531 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1715281896", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-493868041", "security_groups": [{"name": "tempest-secgroup-smoke-645306244"}], "block_device_mapping_v2": [{"uuid": "db47f675-250e-4b19-85a1-307552d43d09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93b3736e-f236-4f4c-bc10-39fdec95bd29"}]}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:06.620173 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:06.814723 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] validate_networks() for [('93b3736e-f236-4f4c-bc10-39fdec95bd29', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:21:07.596125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:21:07.596773 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:21:07.598497 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:21:07.599240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:21:07.599700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:21:07.610195 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:07.611269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:07.611969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:07.612923 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:07.614266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:07.614908 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:07.625848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:07.646038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:07.651515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Getting quotas for user a94af170fb414928970e7353964e31c0 and project c6be9a9db45a423c9f4baec61d3e0228. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:07.752330 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:21:07.758796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db47f675-250e-4b19-85a1-307552d43d09',volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:21:08.030137 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1531e71b-9db7-491b-8248-8f92745779e2 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.449917 Aug 29 20:21:08.039686 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 380/780] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:21:06 2022] POST /compute/v2.1/servers => generated 407 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:21:08.042507 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16d651ff-4ce4-4c1c-a9c9-d8efd4849d6d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:08.043145 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16d651ff-4ce4-4c1c-a9c9-d8efd4849d6d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:08.045746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:08.228864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-16d651ff-4ce4-4c1c-a9c9-d8efd4849d6d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:08.236066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16d651ff-4ce4-4c1c-a9c9-d8efd4849d6d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1097 microversion: 2.1 time: 0.197226 Aug 29 20:21:08.242798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 401/781] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:08 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1097 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:09.263151 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:09.263804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:09.281827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:09.282587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:09.283400 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:09.284320 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:09.285316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:09.286304 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:09.416382 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:09.431391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-078a2b76-c057-4114-aff0-6f8ec2cb0185 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1195 microversion: 2.1 time: 0.173957 Aug 29 20:21:09.442215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 381/782] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:09 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1195 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:10.179917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:10.451683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:10.452427 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:10.458802 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a78b38c8-7423-4f21-b955-b3d9506dc8b2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'create', calling method: .version_select at 0x7f446cd1e310>, body: {"keypair": {"name": "tempest-keypair-1179284927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm945CwTsojHdOwnMmN6bN4u5bDfFOghejmpZKiXtzz+TMOmGCUFBwzs3ylax3EpfGsLxLFSiI2hkqdjxzRydWJaio3T8OAQQws0ULYabwuwZSLzL3KI7ABl44JXu7exg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:10.466313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:10.468263 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:10.468803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:10.469555 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:10.470050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:10.475427 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:10.503045 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-a78b38c8-7423-4f21-b955-b3d9506dc8b2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for project 40982cedd7d840248a05e55d65606b7c. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:10.521649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-a78b38c8-7423-4f21-b955-b3d9506dc8b2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for user fdba9c71297941608b065dbc3b2015ce and project 40982cedd7d840248a05e55d65606b7c. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:10.579423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a78b38c8-7423-4f21-b955-b3d9506dc8b2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401058 Aug 29 20:21:10.587008 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 402/783] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:21:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:10.691202 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:10.699207 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e4202893-77e7-446e-9994-9827085e543e tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1213 microversion: 2.1 time: 0.252584 Aug 29 20:21:10.713343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 382/784] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:10 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1213 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:11.720585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:11.721198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:11.743189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:11.747878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:11.748581 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:11.754232 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:11.759685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:11.760299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:12.129273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:12.143853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5bc09c1c-ecb0-4b5f-9bf6-9570361b3539 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.426417 Aug 29 20:21:12.145587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 403/785] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:11 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:13.168124 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:13.169537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:13.185383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:13.186075 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:13.186697 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:13.187606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:13.196177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:13.196863 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:13.238191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9b802baf-acd3-4430-8430-99f52b6d389b req-128a1441-d35d-4796-b77d-e9c98bfddd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83bcf88-8091-4f8d-a4da-70fca97f998b", "tag": "7d6824a3-3f0a-45bd-a07c-4410609d94de"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:13.258679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9b802baf-acd3-4430-8430-99f52b6d389b req-128a1441-d35d-4796-b77d-e9c98bfddd80 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:13.259957 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9b802baf-acd3-4430-8430-99f52b6d389b req-128a1441-d35d-4796-b77d-e9c98bfddd80 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:13.263248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9b802baf-acd3-4430-8430-99f52b6d389b req-128a1441-d35d-4796-b77d-e9c98bfddd80 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:13.315845 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9b802baf-acd3-4430-8430-99f52b6d389b req-128a1441-d35d-4796-b77d-e9c98bfddd80 service nova] Creating event network-changed:7d6824a3-3f0a-45bd-a07c-4410609d94de for instance b83bcf88-8091-4f8d-a4da-70fca97f998b on hv-cinder-85426 Aug 29 20:21:13.329168 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9b802baf-acd3-4430-8430-99f52b6d389b req-128a1441-d35d-4796-b77d-e9c98bfddd80 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094730 Aug 29 20:21:13.330343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 404/786] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:13.581144 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:13.594436 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3cb7317c-5f1e-4f93-958f-df4d2e604eec tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.427787 Aug 29 20:21:13.595509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 383/787] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:13 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:14.619885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:14.620721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:14.640145 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:14.645807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:14.646817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:14.648299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:14.650353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:14.653419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:14.880950 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:14.890459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90f1cfbf-7cac-4b1e-84bf-31832047c386 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.277839 Aug 29 20:21:14.891387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 405/788] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:14 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:15.017597 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1921959097", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4efebb65-54be-4a0b-8bb3-3efe85fc7e8a"}], "security_groups": [{"name": "tempest-securitygroup--1027755694"}], "key_name": "tempest-keypair-1179284927", "user_data": "}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:15.164679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] validate_networks() for [('4efebb65-54be-4a0b-8bb3-3efe85fc7e8a', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:21:15.842814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:21:15.843628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:21:15.845135 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:21:15.846158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:21:15.847655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:21:15.869158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:15.870554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:15.871526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:15.872492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:15.877741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:15.882660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:15.915729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:15.916478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:15.931298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:15.936618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:15.937277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:15.938388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:15.939475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:15.940216 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:15.959396 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for project 40982cedd7d840248a05e55d65606b7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:15.967565 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for user fdba9c71297941608b065dbc3b2015ce and project 40982cedd7d840248a05e55d65606b7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:16.038243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:21:16.041719 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:21:16.163870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-921be688-680e-487e-8317-121c2b965e94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.146559 Aug 29 20:21:16.170571 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 384/789] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:21:15 2022] POST /compute/v2.1/servers => generated 404 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:21:16.178394 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-65b4c987-0de5-4521-9939-41dcb7432a2c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:16.182341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-65b4c987-0de5-4521-9939-41dcb7432a2c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:16.312860 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-65b4c987-0de5-4521-9939-41dcb7432a2c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:16.321729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:16.326058 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-65b4c987-0de5-4521-9939-41dcb7432a2c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1242 microversion: 2.1 time: 0.152467 Aug 29 20:21:16.337108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03fa8a43-9ae8-45ef-a99e-bd3be32066bb tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.425409 Aug 29 20:21:16.345811 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 385/790] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:16 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1242 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:16.352001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 406/791] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:15 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:17.350002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:17.351467 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:17.358438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:17.359874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:17.369284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:17.373342 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:17.375388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:17.375388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:17.375388 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:17.376791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:17.377461 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:17.378541 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:17.379589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:17.380301 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:17.381182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:17.382179 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:17.502755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:17.521755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a8f95cdb-eb7c-4713-9a7e-9a677d7f01d6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1246 microversion: 2.1 time: 0.175588 Aug 29 20:21:17.522913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 386/792] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:17 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1246 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:17.669959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:17.678938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-84d85ea0-be66-442b-9826-cd21942109db tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.324110 Aug 29 20:21:17.684090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 407/793] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:17 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:18.544071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:18.544866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:18.560904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:18.561408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:18.561945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:18.562663 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:18.563388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:18.564052 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:18.708882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:18.710479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:18.717297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:18.718192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:18.718818 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:18.720030 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:18.720684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:18.725239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:18.733997 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:18.744168 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9a4c55e3-b4ee-4f00-84a2-3330d6822c9e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1246 microversion: 2.1 time: 0.205268 Aug 29 20:21:18.744760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 387/794] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:18 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1246 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:18.987390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:18.996851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e7eb746-942a-40f5-9668-eeeb0e335457 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.293706 Aug 29 20:21:18.998299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 408/795] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:18 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:19.766931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:19.767522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:19.776558 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:19.777497 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:19.778154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:19.778873 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:19.779711 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:19.780137 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:19.853377 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:19.866410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2c8099c6-cd87-49ad-a597-c4535c8f0be2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1294 microversion: 2.1 time: 0.104486 Aug 29 20:21:19.867485 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 388/796] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:19 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:20.022444 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:20.025111 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:20.033763 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:20.034327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:20.035012 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:20.036805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:20.038263 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:20.038893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:20.214755 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:20.224304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d7b2fb5-d18b-444e-a9bd-50cfbbc50789 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.208201 Aug 29 20:21:20.224892 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 409/797] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:20 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:20.888265 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:20.889822 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:20.904260 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:20.907155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:20.907807 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:20.908554 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:20.910824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:20.920771 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:21.027960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:21.040648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a1c0c365-9be5-45df-bd9a-ea4e213c7bcb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1312 microversion: 2.1 time: 0.155119 Aug 29 20:21:21.041448 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 389/798] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:20 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:21.125902 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:21.244628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:21.245620 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:21.254020 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:21.254966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:21.255741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:21.257290 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:21.258148 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:21.258796 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:21.416851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aad75154-e2cf-432f-bf6c-ddbc8ff64262 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Action: 'create', calling method: .version_select at 0x7f446ccb7940>, body: {"keypair": {"name": "tempest-TestShelveInstance-61233733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRLa63J9u7nmkKanigDrwyS2OC8QFKEjgYyoRqdpBV/clswbTWj4rnlohjVsPbQkmKr0Ew5O3lewObURCTUgozcW5V5BKDWfRp5yMwL0IsN27T6tOrEcMYswKKRNXbhIQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:21.438790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:21.439415 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-aad75154-e2cf-432f-bf6c-ddbc8ff64262 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Getting quotas for project 2913c266bd434f4dbb8eef6fb9a862fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:21.444870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-aad75154-e2cf-432f-bf6c-ddbc8ff64262 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Getting quotas for user 6996fd3733504e89ac78fa33ca9158ed and project 2913c266bd434f4dbb8eef6fb9a862fd. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:21.447633 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-db04f741-9872-4330-b002-c211407a59de tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.207094 Aug 29 20:21:21.448230 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 390/799] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:21 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:21.477826 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aad75154-e2cf-432f-bf6c-ddbc8ff64262 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.362041 Aug 29 20:21:21.478920 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 410/800] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:21:21 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:22.061967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:22.062586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:22.087686 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.088200 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.088640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.096387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.097426 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.097869 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.367485 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:22.382002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8e49b44d-8b2c-4615-86a0-5f6758dbecb3 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.322659 Aug 29 20:21:22.382002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 391/801] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:22 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:22.472734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:22.474812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:22.485109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.486000 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.486906 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.492475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:22.492938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:22.495119 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:22.714205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:22.736731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a74a4618-f0d9-4ed1-8a52-37a0e972b903 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.264812 Aug 29 20:21:22.738085 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 411/802] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:22 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:23.264827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-b92e54b4-d342-46ec-8fe6-91c4bb98eade req-130f3ae6-c083-492f-a4bb-58634709468d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1b5faf-7e07-4876-9370-ad143689d94d", "tag": "4be43781-5af8-4299-ba83-6e12008e0fb7"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:23.276112 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-b92e54b4-d342-46ec-8fe6-91c4bb98eade req-130f3ae6-c083-492f-a4bb-58634709468d service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.276584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-b92e54b4-d342-46ec-8fe6-91c4bb98eade req-130f3ae6-c083-492f-a4bb-58634709468d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.277193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-b92e54b4-d342-46ec-8fe6-91c4bb98eade req-130f3ae6-c083-492f-a4bb-58634709468d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.291517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-b92e54b4-d342-46ec-8fe6-91c4bb98eade req-130f3ae6-c083-492f-a4bb-58634709468d service nova] Creating event network-changed:4be43781-5af8-4299-ba83-6e12008e0fb7 for instance 3e1b5faf-7e07-4876-9370-ad143689d94d on hv-cinder-85426 Aug 29 20:21:23.297432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-b92e54b4-d342-46ec-8fe6-91c4bb98eade req-130f3ae6-c083-492f-a4bb-58634709468d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039011 Aug 29 20:21:23.298035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 392/803] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:23.408819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:23.409666 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:23.417754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.418964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.419824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.421010 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.422970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.423587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.588475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:23.597634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c84c439c-9300-40fd-af21-034c09841661 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.194436 Aug 29 20:21:23.598533 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 412/804] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:23 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:23.762587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:23.763875 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:23.779476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.779476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.779476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.779476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:23.779846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:23.779846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:23.918416 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:23.927171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-61c52e79-ceb6-4ca3-8afa-b7686f6b5937 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.171902 Aug 29 20:21:23.927733 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 393/805] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:23 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:24.617926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:24.618607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:24.624375 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-440a16d5-8ad6-41ed-877d-2f1fbd5bd009 req-94c95138-71de-4403-81ff-c01329c2cf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83bcf88-8091-4f8d-a4da-70fca97f998b", "name": "network-vif-plugged", "status": "completed", "tag": "7d6824a3-3f0a-45bd-a07c-4410609d94de"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:24.625086 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:24.625759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:24.626198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:24.626962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:24.627451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:24.627879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:24.635377 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-440a16d5-8ad6-41ed-877d-2f1fbd5bd009 req-94c95138-71de-4403-81ff-c01329c2cf5f service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:24.635884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-440a16d5-8ad6-41ed-877d-2f1fbd5bd009 req-94c95138-71de-4403-81ff-c01329c2cf5f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:24.637136 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-440a16d5-8ad6-41ed-877d-2f1fbd5bd009 req-94c95138-71de-4403-81ff-c01329c2cf5f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:24.653075 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-440a16d5-8ad6-41ed-877d-2f1fbd5bd009 req-94c95138-71de-4403-81ff-c01329c2cf5f service nova] Creating event network-vif-plugged:7d6824a3-3f0a-45bd-a07c-4410609d94de for instance b83bcf88-8091-4f8d-a4da-70fca97f998b on hv-cinder-85426 Aug 29 20:21:24.658224 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-440a16d5-8ad6-41ed-877d-2f1fbd5bd009 req-94c95138-71de-4403-81ff-c01329c2cf5f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038152 Aug 29 20:21:24.659341 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 394/806] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:21:24.775664 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:24.784441 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15e1b583-05d6-4085-8bdd-efed82ec16ba tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.169980 Aug 29 20:21:24.790985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 413/807] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:24 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:24.949962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:24.950934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:24.958958 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:24.959606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:24.960319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:24.961111 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:24.961645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:24.962141 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:25.134264 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:25.146757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-86efcec9-bf7b-4212-b6b7-3c1ba047933d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.203129 Aug 29 20:21:25.148710 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 395/808] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:24 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:25.806844 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:25.808123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:25.815551 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:25.816087 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:25.816558 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:25.817270 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:25.817905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:25.818490 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:25.962705 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:25.971250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9887c3a9-1e7e-4495-83f0-b078a754d662 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.168048 Aug 29 20:21:25.971933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 414/809] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:25 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:26.169100 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:26.169820 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:26.172459 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=4 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:26.178222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:26.178710 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:26.179170 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:26.179889 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:26.180386 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:26.180925 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:26.322581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:26.325381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=14 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:26.332418 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c9a893cd-3984-489d-b6bf-db3839c6400b tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1268 microversion: 2.1 time: 0.167228 Aug 29 20:21:26.333751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 396/810] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:26 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:26.993517 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:26.994118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:27.007010 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.007577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.008008 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.010933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.011942 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.012540 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.184455 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:27.196425 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78d354bb-4068-43c9-8a6e-173158fcc498 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.206661 Aug 29 20:21:27.196685 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 415/811] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:26 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:27.353984 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:27.354748 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:27.362147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.362719 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.363183 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.363891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.364349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.364776 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.515108 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:27.523056 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2f57dd1d-9439-4041-8d0c-26b96a52f4c6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1454 microversion: 2.1 time: 0.173110 Aug 29 20:21:27.523636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 397/812] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:27 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1454 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:27.543043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:27.543709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:27.549657 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.550696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.551135 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.551820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:27.552285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:27.552709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:27.684251 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:27.691914 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-948b6524-ced7-4791-bb4d-9c25ea56be65 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1454 microversion: 2.1 time: 0.152885 Aug 29 20:21:27.692467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 416/813] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:27 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:28.223981 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:28.226034 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:28.233883 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:28.234714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:28.235774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:28.236716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:28.237335 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:28.238616 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:28.449050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:28.460982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-25f9d11b-28ae-4ac7-891b-f5deb26b81ac tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.247004 Aug 29 20:21:28.461566 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 398/814] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:28 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:28.789863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e0b884c3-d6cc-4d42-b7d9-4c58ee622ab5 req-c15bc510-8e8f-47b8-acd4-8b62d7f8b33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1b5faf-7e07-4876-9370-ad143689d94d", "name": "network-vif-plugged", "status": "completed", "tag": "4be43781-5af8-4299-ba83-6e12008e0fb7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:28.799842 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e0b884c3-d6cc-4d42-b7d9-4c58ee622ab5 req-c15bc510-8e8f-47b8-acd4-8b62d7f8b33c service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:28.801179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e0b884c3-d6cc-4d42-b7d9-4c58ee622ab5 req-c15bc510-8e8f-47b8-acd4-8b62d7f8b33c service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:28.801821 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e0b884c3-d6cc-4d42-b7d9-4c58ee622ab5 req-c15bc510-8e8f-47b8-acd4-8b62d7f8b33c service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:28.815396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e0b884c3-d6cc-4d42-b7d9-4c58ee622ab5 req-c15bc510-8e8f-47b8-acd4-8b62d7f8b33c service nova] Creating event network-vif-plugged:4be43781-5af8-4299-ba83-6e12008e0fb7 for instance 3e1b5faf-7e07-4876-9370-ad143689d94d on hv-cinder-85426 Aug 29 20:21:28.820524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e0b884c3-d6cc-4d42-b7d9-4c58ee622ab5 req-c15bc510-8e8f-47b8-acd4-8b62d7f8b33c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 Aug 29 20:21:28.821112 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 417/815] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:29.483183 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:29.485540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:29.493975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:29.495099 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:29.495778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:29.496691 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:29.497183 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:29.497695 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:29.640641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:29.653334 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f0a33774-b8c5-48d6-8600-b4e3b15ee280 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.174593 Aug 29 20:21:29.653854 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 399/816] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:29 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:29.691878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0f0b957d-feee-4ddc-b914-ce7f31123d7f req-2426945b-952d-4553-a2e8-b10bbfe33343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83bcf88-8091-4f8d-a4da-70fca97f998b", "tag": "7d6824a3-3f0a-45bd-a07c-4410609d94de"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:29.701317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0f0b957d-feee-4ddc-b914-ce7f31123d7f req-2426945b-952d-4553-a2e8-b10bbfe33343 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:29.701778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0f0b957d-feee-4ddc-b914-ce7f31123d7f req-2426945b-952d-4553-a2e8-b10bbfe33343 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:29.702208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0f0b957d-feee-4ddc-b914-ce7f31123d7f req-2426945b-952d-4553-a2e8-b10bbfe33343 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:29.714623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0f0b957d-feee-4ddc-b914-ce7f31123d7f req-2426945b-952d-4553-a2e8-b10bbfe33343 service nova] Creating event network-changed:7d6824a3-3f0a-45bd-a07c-4410609d94de for instance b83bcf88-8091-4f8d-a4da-70fca97f998b on hv-cinder-85426 Aug 29 20:21:29.719811 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0f0b957d-feee-4ddc-b914-ce7f31123d7f req-2426945b-952d-4553-a2e8-b10bbfe33343 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032616 Aug 29 20:21:29.720414 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 418/817] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:30.678320 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:30.679208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:30.694459 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:30.695297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:30.695932 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:30.696977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:30.697616 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:30.698243 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:30.727861 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=100 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:30.880033 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:30.888122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fa6ca770-9633-415e-8de2-eba8616a0d64 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1368 microversion: 2.1 time: 0.217599 Aug 29 20:21:30.903351 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 400/818] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:30 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:31.910888 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:31.911638 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:31.914013 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:31.919805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:31.920321 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:31.920782 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:31.921483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:31.921951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:31.922361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:32.064821 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:32.073391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89804f38-a18c-4281-8076-dc478d72dedb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1555 microversion: 2.1 time: 0.167127 Aug 29 20:21:32.073996 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 419/819] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:31 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:32.094410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:32.094943 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:32.101884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:32.102362 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:32.102955 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:32.103825 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:32.104279 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:32.104735 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:32.180508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6af3ecfe-faa7-4769-86a2-415f2b35b87d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089890 Aug 29 20:21:32.181105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 401/820] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:21:32 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:33.347724 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-361f3ffd-1a92-4134-a827-45884ff27472 req-86001a1a-1c1d-425e-b159-571ca28f3270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1b5faf-7e07-4876-9370-ad143689d94d", "tag": "4be43781-5af8-4299-ba83-6e12008e0fb7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:33.357847 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-361f3ffd-1a92-4134-a827-45884ff27472 req-86001a1a-1c1d-425e-b159-571ca28f3270 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:33.358328 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-361f3ffd-1a92-4134-a827-45884ff27472 req-86001a1a-1c1d-425e-b159-571ca28f3270 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:33.358765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-361f3ffd-1a92-4134-a827-45884ff27472 req-86001a1a-1c1d-425e-b159-571ca28f3270 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:33.370387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-361f3ffd-1a92-4134-a827-45884ff27472 req-86001a1a-1c1d-425e-b159-571ca28f3270 service nova] Creating event network-changed:4be43781-5af8-4299-ba83-6e12008e0fb7 for instance 3e1b5faf-7e07-4876-9370-ad143689d94d on hv-cinder-85426 Aug 29 20:21:33.375916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-361f3ffd-1a92-4134-a827-45884ff27472 req-86001a1a-1c1d-425e-b159-571ca28f3270 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032505 Aug 29 20:21:33.376737 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 420/821] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:46.910803 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:46.911577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=7 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:46.915786 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1534066846", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-61233733", "security_groups": [{"name": "tempest-secgroup-smoke-750584559"}], "networks": [{"uuid": "f7f6aa5d-7738-40de-a070-f871eb0331e9"}], "block_device_mapping_v2": [{"uuid": "750a5a6c-ae39-4e22-ba32-034fd9bf52f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:47.028153 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] validate_networks() for [('f7f6aa5d-7738-40de-a070-f871eb0331e9', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:21:47.389137 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:21:47.389583 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:21:47.390303 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:21:47.390731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:21:47.391160 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:21:47.400018 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:47.400489 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:47.400917 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:47.401627 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:47.402078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:47.402492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:47.420174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Getting quotas for project 2913c266bd434f4dbb8eef6fb9a862fd. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:47.424746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Getting quotas for user 6996fd3733504e89ac78fa33ca9158ed and project 2913c266bd434f4dbb8eef6fb9a862fd. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:47.481094 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:21:47.483250 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='750a5a6c-ae39-4e22-ba32-034fd9bf52f9',volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:21:47.614559 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7a0f177e-b8b7-4079-b998-a8af7b348491 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.705045 Aug 29 20:21:47.615239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 402/822] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:21:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:21:47.623950 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:47.624687 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=86 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:47.632886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca972235-b610-4a26-8f5f-9bed0b3e3ff1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:47.633708 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca972235-b610-4a26-8f5f-9bed0b3e3ff1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:47.690387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca972235-b610-4a26-8f5f-9bed0b3e3ff1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:47.697635 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca972235-b610-4a26-8f5f-9bed0b3e3ff1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1090 microversion: 2.1 time: 0.075348 Aug 29 20:21:47.698397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 421/823] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:47 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1090 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:48.718556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:48.719316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:48.727309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:48.727806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:48.728242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:48.728938 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:48.729395 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:48.729820 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:48.793030 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:48.801317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f581a65f-c10b-43ff-98a0-d7517a25eb85 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1188 microversion: 2.1 time: 0.087358 Aug 29 20:21:48.801891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 403/824] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:48 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:49.823741 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:49.824472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:49.832658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:49.833146 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:49.833574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:49.834301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:49.834753 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:49.835197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:49.917428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:49.927896 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2072f2c9-9b58-4d16-88b7-ba70c00b82f9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1206 microversion: 2.1 time: 0.108734 Aug 29 20:21:49.941953 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 422/825] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:49 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1206 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:50.742941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-321a0472-126d-45de-bc2c-98dabe45f66a req-4fefc97a-8696-4346-a5e9-6a53324864bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cec8d92-b96e-4c8a-a010-384124fb6248", "tag": "1477bb14-bbd7-4b05-8df2-1bdeca091ad8"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:50.756471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-321a0472-126d-45de-bc2c-98dabe45f66a req-4fefc97a-8696-4346-a5e9-6a53324864bd service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:50.757431 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-321a0472-126d-45de-bc2c-98dabe45f66a req-4fefc97a-8696-4346-a5e9-6a53324864bd service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:50.757868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-321a0472-126d-45de-bc2c-98dabe45f66a req-4fefc97a-8696-4346-a5e9-6a53324864bd service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:50.770964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-321a0472-126d-45de-bc2c-98dabe45f66a req-4fefc97a-8696-4346-a5e9-6a53324864bd service nova] Creating event network-changed:1477bb14-bbd7-4b05-8df2-1bdeca091ad8 for instance 0cec8d92-b96e-4c8a-a010-384124fb6248 on hv-cinder-85426 Aug 29 20:21:50.776560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-321a0472-126d-45de-bc2c-98dabe45f66a req-4fefc97a-8696-4346-a5e9-6a53324864bd service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037845 Aug 29 20:21:50.777848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 404/826] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:21:50.950356 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:50.951202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:50.957640 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:50.958143 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:50.958716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:50.959484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:50.959960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:50.960396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:51.091810 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:51.100227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80f71031-dfb8-446a-8314-2603a8e8fa5b tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.153783 Aug 29 20:21:51.100805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 423/827] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:50 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:52.122222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:52.122864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:52.132390 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:52.132880 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:52.133314 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:52.134009 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:52.134465 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:52.134891 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:52.268911 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:52.276522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-39be1162-d688-48a1-9983-ba34313287d7 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.158645 Aug 29 20:21:52.277774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 405/828] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:52 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:53.298097 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:53.299309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:53.305351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:53.305826 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:53.306252 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:53.306926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:53.307480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:53.307899 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:53.439274 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:53.446823 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52ec5932-c6e6-4bbd-8224-c8c727b07be0 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.152633 Aug 29 20:21:53.447428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 424/829] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:53 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:54.467618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:54.468228 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:54.475255 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:54.476321 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:54.476761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:54.477456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:54.477911 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:54.478333 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:54.624159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:54.633096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6fb9a5e4-712c-466e-8dd1-92cc2a338261 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.169343 Aug 29 20:21:54.633982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 406/830] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:54 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:55.653760 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:55.654363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:55.661282 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:55.661692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:55.662133 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:55.662816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:55.663294 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:55.663716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:55.832438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:55.847562 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-216854c7-6601-487a-8362-e68cdc40e60d tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.197538 Aug 29 20:21:55.848683 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 425/831] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:55 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:56.868074 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:56.868680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:56.875002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:56.875511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:56.875961 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:56.876645 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:56.877752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:56.878176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:57.006701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:57.014363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f784fc20-6888-437e-b8ae-06bc9e10dc52 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.150105 Aug 29 20:21:57.015207 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 407/832] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:56 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:57.388111 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-235944038", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "networks": [{"uuid": "1ec36a05-6a5a-484d-a939-2db44f4b4d4f"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:21:57.440832 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] validate_networks() for [('1ec36a05-6a5a-484d-a939-2db44f4b4d4f', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:21:57.694137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:57.782117 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:21:57.782530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:21:57.783644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:21:57.784049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:21:57.784452 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:21:57.793121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:57.793600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:57.794024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:57.794738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:57.795222 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:57.795643 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:57.812355 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Getting quotas for project 04ea268b7d1f4d4185c1a69e8787de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:21:57.816620 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Getting quotas for user 59c39a66e58b4dd89a8e7468ab352436 and project 04ea268b7d1f4d4185c1a69e8787de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:21:57.827457 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:21:57.830267 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:21:57.872796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [4959319c-ee92-4fbd-a1ae-a1dee76dcd1e] AMQP server on 10.222.0.121:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 20:21:58.034813 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:58.035466 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:58.037383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:58.038026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:58.044339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:58.044818 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:58.045245 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:58.045930 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:58.046382 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:58.046800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:58.178918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:58.186634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e5d5013c-b870-491b-9ee9-8b84df1fc192 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.155782 Aug 29 20:21:58.187215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 408/833] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:58 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:21:58.880841 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [4959319c-ee92-4fbd-a1ae-a1dee76dcd1e] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 54130. Aug 29 20:21:58.885277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c036c88-f3ab-4f9c-8f1e-3f1bce514eda tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.500931 Aug 29 20:21:58.885931 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 426/834] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:21:57 2022] POST /compute/v2.1/servers => generated 382 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:21:58.896832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f4776265-5c16-4a62-bbc5-ae70c54f89b3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:58.897687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f4776265-5c16-4a62-bbc5-ae70c54f89b3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:58.964266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f4776265-5c16-4a62-bbc5-ae70c54f89b3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:58.971755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f4776265-5c16-4a62-bbc5-ae70c54f89b3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1222 microversion: 2.1 time: 0.078682 Aug 29 20:21:58.972323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 409/835] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:58 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:59.210165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:59.211434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:59.219722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.220310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.220812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.221594 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.222126 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:21:59.222625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:21:59.366759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:21:59.375108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-915fe7f5-154a-4848-91d6-989158032686 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.170679 Aug 29 20:21:59.375777 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 427/836] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:59 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:21:59.992170 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:21:59.992777 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:21:59.999062 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:21:59.999569 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.000031 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.000720 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.001173 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.001602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.069314 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:00.077405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8c832c84-d801-4d47-bc35-e51d654588e3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1274 microversion: 2.1 time: 0.088999 Aug 29 20:22:00.078191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 410/837] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:21:59 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:00.396757 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:00.397364 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:00.403785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.404274 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.404708 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.405408 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.405870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.406485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.540727 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:00.549466 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9342d722-391a-46b2-b055-099179bf8e45 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.157079 Aug 29 20:22:00.550056 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 428/838] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:00 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:00.827375 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-68ef0bb8-b68a-429e-b4f2-62075ea8f4c4 req-cb8a841b-acd1-4960-8c3e-fa71f6438cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cec8d92-b96e-4c8a-a010-384124fb6248", "name": "network-vif-plugged", "status": "completed", "tag": "1477bb14-bbd7-4b05-8df2-1bdeca091ad8"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:00.837844 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-68ef0bb8-b68a-429e-b4f2-62075ea8f4c4 req-cb8a841b-acd1-4960-8c3e-fa71f6438cb1 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:00.838443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-68ef0bb8-b68a-429e-b4f2-62075ea8f4c4 req-cb8a841b-acd1-4960-8c3e-fa71f6438cb1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:00.839006 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-68ef0bb8-b68a-429e-b4f2-62075ea8f4c4 req-cb8a841b-acd1-4960-8c3e-fa71f6438cb1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:00.860259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-68ef0bb8-b68a-429e-b4f2-62075ea8f4c4 req-cb8a841b-acd1-4960-8c3e-fa71f6438cb1 service nova] Creating event network-vif-plugged:1477bb14-bbd7-4b05-8df2-1bdeca091ad8 for instance 0cec8d92-b96e-4c8a-a010-384124fb6248 on hv-cinder-85426 Aug 29 20:22:00.866296 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-68ef0bb8-b68a-429e-b4f2-62075ea8f4c4 req-cb8a841b-acd1-4960-8c3e-fa71f6438cb1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042856 Aug 29 20:22:00.867247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 411/839] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:01.098396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:01.098919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:01.105576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.106070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.106512 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.107518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.107980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.108512 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.238316 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:01.246370 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9dea7915-8b70-424c-8863-ebf70e49f613 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1322 microversion: 2.1 time: 0.152270 Aug 29 20:22:01.259958 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 429/840] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:01 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:01.463718 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-1b1603c4-26d7-4d3f-937a-409825d65e58 req-94fc4d9a-2651-45da-b7d5-1f11aeab1086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a925ed9e-9777-434a-a778-395d0250e0e2", "tag": "6080113a-f17e-4301-8c74-c101dde0273b"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:01.474273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1b1603c4-26d7-4d3f-937a-409825d65e58 req-94fc4d9a-2651-45da-b7d5-1f11aeab1086 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.474752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1b1603c4-26d7-4d3f-937a-409825d65e58 req-94fc4d9a-2651-45da-b7d5-1f11aeab1086 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.475222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1b1603c4-26d7-4d3f-937a-409825d65e58 req-94fc4d9a-2651-45da-b7d5-1f11aeab1086 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.486257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-1b1603c4-26d7-4d3f-937a-409825d65e58 req-94fc4d9a-2651-45da-b7d5-1f11aeab1086 service nova] Creating event network-changed:6080113a-f17e-4301-8c74-c101dde0273b for instance a925ed9e-9777-434a-a778-395d0250e0e2 on hv-cinder-85426 Aug 29 20:22:01.490740 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-1b1603c4-26d7-4d3f-937a-409825d65e58 req-94fc4d9a-2651-45da-b7d5-1f11aeab1086 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032019 Aug 29 20:22:01.491369 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 412/841] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:01.570391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:01.571006 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:01.577628 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.578116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.578552 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.579293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:01.580254 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:01.580676 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:01.713073 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:01.720970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75792f96-c6af-493d-b159-6366bce9fa26 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.154437 Aug 29 20:22:01.721551 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 430/842] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:01 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:02.268564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:02.269176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:02.275225 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.275706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.276198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.276881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.277333 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.277750 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.408545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:02.417015 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c62654fe-8ee4-4d91-9117-d364d8eb8905 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1322 microversion: 2.1 time: 0.153038 Aug 29 20:22:02.417583 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 413/843] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:02 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:02.741349 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:02.741974 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:02.748376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.748854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.749288 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.749964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:02.750410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:02.750824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:02.885180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:02.893777 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b8f1e676-5bc5-4c43-9359-f80e06f9b16e tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1261 microversion: 2.1 time: 0.156244 Aug 29 20:22:02.894351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 431/844] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:02 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:03.439816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:03.440431 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:03.446738 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.447295 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.447768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:03.448435 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.448886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.449305 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:03.575496 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:03.583541 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e40d65e6-eef2-488e-977f-9570ee81a091 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1322 microversion: 2.1 time: 0.147542 Aug 29 20:22:03.584104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 414/845] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:03 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:03.914537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:03.915552 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:03.922393 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.922873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.923338 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:03.924029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:03.924484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:03.924908 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.057146 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.065391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f2ce720-ff1d-4b75-97bd-534963c77762 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1445 microversion: 2.1 time: 0.155036 Aug 29 20:22:04.065965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 432/846] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:03 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:04.085453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:04.086065 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:04.092003 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.092490 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.092926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.093623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.094081 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.094504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.232716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.241120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-dd892787-6a87-40be-8636-ecbc3b4b4ff3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1445 microversion: 2.1 time: 0.159544 Aug 29 20:22:04.241740 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 415/847] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:04 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:04.604059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:04.604565 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:04.610499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.611645 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.612081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.612786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:04.613248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:04.613678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:04.815822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:04.823634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c32c7584-c00c-4465-9fd8-cfabc4e073da tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1322 microversion: 2.1 time: 0.223509 Aug 29 20:22:04.824210 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 433/848] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:04 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:05.845085 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:05.845693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:05.852553 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:05.853038 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:05.853471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:05.854168 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:05.854623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:05.855042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:06.083226 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:06.090876 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c38fcde1-01aa-4c52-829e-486a52804360 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1322 microversion: 2.1 time: 0.249751 Aug 29 20:22:06.091488 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 416/849] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:05 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:06.259390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2a647aef-92da-4b82-a1e2-4cf9f2f9962e req-8278b5fd-f476-4b31-9c2c-f56a387ff5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cec8d92-b96e-4c8a-a010-384124fb6248", "tag": "1477bb14-bbd7-4b05-8df2-1bdeca091ad8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:06.269404 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2a647aef-92da-4b82-a1e2-4cf9f2f9962e req-8278b5fd-f476-4b31-9c2c-f56a387ff5d8 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:06.269877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2a647aef-92da-4b82-a1e2-4cf9f2f9962e req-8278b5fd-f476-4b31-9c2c-f56a387ff5d8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:06.270682 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2a647aef-92da-4b82-a1e2-4cf9f2f9962e req-8278b5fd-f476-4b31-9c2c-f56a387ff5d8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:06.282798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2a647aef-92da-4b82-a1e2-4cf9f2f9962e req-8278b5fd-f476-4b31-9c2c-f56a387ff5d8 service nova] Creating event network-changed:1477bb14-bbd7-4b05-8df2-1bdeca091ad8 for instance 0cec8d92-b96e-4c8a-a010-384124fb6248 on hv-cinder-85426 Aug 29 20:22:06.288817 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2a647aef-92da-4b82-a1e2-4cf9f2f9962e req-8278b5fd-f476-4b31-9c2c-f56a387ff5d8 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033007 Aug 29 20:22:06.289556 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 434/850] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:07.086199 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-f9d48ea3-76f1-4e3a-9f6f-426fb6ffd811 req-cfbdc5a7-1b88-4e7d-a8b6-9859a0523fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a925ed9e-9777-434a-a778-395d0250e0e2", "name": "network-vif-plugged", "status": "completed", "tag": "6080113a-f17e-4301-8c74-c101dde0273b"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:07.095440 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-f9d48ea3-76f1-4e3a-9f6f-426fb6ffd811 req-cfbdc5a7-1b88-4e7d-a8b6-9859a0523fb6 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:07.095923 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-f9d48ea3-76f1-4e3a-9f6f-426fb6ffd811 req-cfbdc5a7-1b88-4e7d-a8b6-9859a0523fb6 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:07.096352 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-f9d48ea3-76f1-4e3a-9f6f-426fb6ffd811 req-cfbdc5a7-1b88-4e7d-a8b6-9859a0523fb6 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:07.114642 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:07.115378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:07.118932 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-f9d48ea3-76f1-4e3a-9f6f-426fb6ffd811 req-cfbdc5a7-1b88-4e7d-a8b6-9859a0523fb6 service nova] Creating event network-vif-plugged:6080113a-f17e-4301-8c74-c101dde0273b for instance a925ed9e-9777-434a-a778-395d0250e0e2 on hv-cinder-85426 Aug 29 20:22:07.122204 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:07.122955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:07.123608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:07.124249 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-f9d48ea3-76f1-4e3a-9f6f-426fb6ffd811 req-cfbdc5a7-1b88-4e7d-a8b6-9859a0523fb6 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041839 Aug 29 20:22:07.124531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:07.125022 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 417/851] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:07.125250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:07.125747 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:07.272851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:07.281148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32e0886f-ff18-4556-a63f-603de8295fbc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1322 microversion: 2.1 time: 0.171759 Aug 29 20:22:07.281981 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 435/852] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:07 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:08.302806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:08.303525 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:08.310204 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:08.310684 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:08.311145 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:08.311827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:08.312280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:08.312699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:08.450491 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:08.458764 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-abd1dffc-77ab-4421-b3d6-b2298161034c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1322 microversion: 2.1 time: 0.160790 Aug 29 20:22:08.459351 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 418/853] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:08 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:09.479640 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:09.480188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:09.482107 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:09.482762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:09.489956 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.490444 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.490875 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.491596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:09.492052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:09.492475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:09.623662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:09.631492 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbdbdf2f-93b3-4f73-afab-2fb6abd51c86 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1511 microversion: 2.1 time: 0.155915 Aug 29 20:22:09.632062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 436/854] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:09 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:17.148853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:17.149405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:17.151347 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:17.153110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:17.158653 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:17.160525 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:17.160525 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:17.160964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:17.161421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:17.161843 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:17.165310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=77 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:17.188731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d2d2a6f3-2136-4140-bb97-f5d2a2ad2d1f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/ips" status: 200 len: 147 microversion: 2.1 time: 0.043770 Aug 29 20:22:17.189322 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 419/855] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:22:17 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:19.820984 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a977a305-e8a9-4a57-8b1b-668439d1f9a8"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:19.823429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:19.826199 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:19.826944 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=82 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:19.832873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:19.833357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:19.833792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:19.834494 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:19.834949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:19.835427 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:20.085853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7172fa06-1b9b-4054-b3a2-ff1caf85e32e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268646 Aug 29 20:22:20.086537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 437/856] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:22:19 2022] POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:27.612016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-aae94381-85f9-4174-9ab6-fcbaeb2a548a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:27.614548 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:27.615228 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:27.621584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aae94381-85f9-4174-9ab6-fcbaeb2a548a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:27.622063 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aae94381-85f9-4174-9ab6-fcbaeb2a548a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:27.622498 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aae94381-85f9-4174-9ab6-fcbaeb2a548a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:27.681592 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-aae94381-85f9-4174-9ab6-fcbaeb2a548a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Going to try to stop instance {{(pid=120721) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:22:27.723253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-aae94381-85f9-4174-9ab6-fcbaeb2a548a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action" status: 202 len: 0 microversion: 2.1 time: 0.114807 Aug 29 20:22:27.724088 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 420/857] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:22:27 2022] POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:22:27.733759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:27.734527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:27.741621 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:27.742248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:27.742745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:27.743747 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:27.744403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:27.745363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:27.874384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:27.883356 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b60cf1bd-da31-4480-a9a9-57e32a6b564f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.153684 Aug 29 20:22:27.883935 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 438/858] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:27 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:27.965836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95c7142b-6fef-41c9-9e51-c4c0fd255f23", "device": "/dev/sdb"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:27.968781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:27.975494 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:27.975971 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:27.976398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:27.977283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:27.977526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:27.977942 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:28.217877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-602d2659-5022-4886-8c78-d05068b079f4 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "POST /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256200 Aug 29 20:22:28.218514 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 421/859] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:22:27 2022] POST /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:22:28.905331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:28.905994 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:28.912398 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:28.912882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:28.913321 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:28.914017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:28.914479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:28.914905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:29.041955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:29.050158 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c73339f9-89e4-4c08-9556-03d7ff72c241 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.148707 Aug 29 20:22:29.050726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 439/860] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:28 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:30.073364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:30.074066 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:30.080311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:30.080783 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:30.081216 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:30.081909 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:30.082363 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:30.082786 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:30.215157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:30.223504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-cc62ad57-9a13-42fe-8dbc-367dd81fc71a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.155549 Aug 29 20:22:30.224086 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 422/861] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:30 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:31.246486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:31.247183 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:31.253924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:31.254409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:31.254855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:31.255568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:31.256023 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:31.256445 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:31.383414 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:31.391738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d234d2f-b9ab-4bde-8396-ae63d7d4273d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.149777 Aug 29 20:22:31.392300 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 440/862] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:31 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:32.413534 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:32.414170 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:32.420603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:32.421093 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:32.421531 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:32.422226 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:32.422680 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:32.423132 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:32.556449 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:32.564577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e1771c5e-f265-40d3-b47d-dea90da285d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.155011 Aug 29 20:22:32.565137 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 423/863] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:32 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:33.585265 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:33.585867 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:33.592481 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:33.592964 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:33.593397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:33.594085 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:33.594544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:33.594966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:33.721459 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:33.730271 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7105134c-ea3b-494a-96e2-c14454ab682e tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.148821 Aug 29 20:22:33.730871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 441/864] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:33 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:34.757827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:34.758451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:34.765248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:34.765734 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:34.766173 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:34.766872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:34.767370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:34.767802 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:34.898529 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:34.906621 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0946a2bd-fed0-416b-956a-bcd7f99f710a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.152728 Aug 29 20:22:34.907193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 424/865] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:34 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:35.927606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:35.928775 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:35.935882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:35.936353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:35.936786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:35.937481 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:35.939406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:35.939926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:36.070772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:36.078812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d6c0f51-bd8c-40a8-b7e2-2cc276a9b1d1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.155041 Aug 29 20:22:36.079398 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 442/866] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:35 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:37.100662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:37.101258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:37.107759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:37.108234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:37.108682 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:37.109417 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:37.109871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:37.110293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:37.238033 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:37.246976 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-46f2ceb7-1ed3-4f4d-8d0e-a64460846a05 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.150640 Aug 29 20:22:37.247557 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 425/867] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:37 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:38.268609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:38.269221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:38.276171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:38.276649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:38.277078 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:38.277761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:38.278211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:38.278631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:38.409880 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:38.418891 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4dda553-5e2e-4162-8a86-1ae2732edead tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.154130 Aug 29 20:22:38.419505 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 443/868] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:38 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:39.440760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:39.441359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:39.448030 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:39.448509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:39.448939 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:39.449622 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:39.450070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:39.450486 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:39.579282 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:39.587654 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-18fb0aa1-27ad-497c-bce0-75ad8ee9dbd7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.150902 Aug 29 20:22:39.588219 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 426/869] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:39 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:40.608857 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:40.609403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:40.616472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:40.617167 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:40.617581 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:40.618280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:40.618738 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:40.619191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:40.751220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:40.759927 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53a98b39-ff90-4999-972c-2275ec249562 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.155133 Aug 29 20:22:40.760524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 444/870] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:40 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:41.780356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:41.780983 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:41.787384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:41.787865 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:41.788337 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:41.789020 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:41.789475 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:41.789894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:41.916608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:41.924649 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bed6e3d0-a835-4cba-a36e-ca3f63017fdc tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.148171 Aug 29 20:22:41.925214 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 427/871] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:41 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:42.946160 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:42.946796 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:42.953436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:42.953921 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:42.954365 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:42.955056 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:42.955542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:42.955966 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:43.087349 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:43.095480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a71a09dd-e5f6-4779-aa25-948883ca5ced tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.153273 Aug 29 20:22:43.096044 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 445/872] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:42 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:44.116927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:44.119297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:44.126500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:44.126925 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:44.127389 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:44.128147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:44.128608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:44.129032 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:44.261318 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:44.269799 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-326f09b7-b2d2-4cfc-9bc3-bfc625152c7f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.157493 Aug 29 20:22:44.270364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 428/873] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:44 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:45.292479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:45.293095 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:45.299531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:45.300025 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:45.300461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:45.301155 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:45.301615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:45.302041 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:45.431721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:45.439996 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-791fa6c6-9722-4bf1-a58b-eb8e38abf8d8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.152148 Aug 29 20:22:45.440555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 446/874] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:45 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:46.461669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:46.462269 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:46.468679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:46.469164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:46.469599 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:46.470289 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:46.470746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:46.471203 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:46.601590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:46.610061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ff7e103d-f8c7-4e96-a893-d7bd75baf6d0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.152755 Aug 29 20:22:46.610625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 429/875] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:46 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:47.632207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:47.632869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:47.639906 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:47.640407 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:47.640877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:47.641606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:47.642064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:47.642486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:47.768816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:47.777688 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-894c2bc9-6a56-4c1f-aff4-3ac44cc204da tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.150020 Aug 29 20:22:47.778257 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 447/876] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:47 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:48.800453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:48.801223 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:48.807851 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:48.808661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:48.809171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:48.810018 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:48.810577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:48.811020 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:48.945469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:48.953530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-49d0cb45-e1bf-4f3c-9f82-9398cb6244e8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.158025 Aug 29 20:22:48.954095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 430/877] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:48 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:49.974740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:49.975954 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:49.979148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=23 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:49.983096 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:49.983590 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:49.984018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:49.984699 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:49.985150 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:49.985599 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:49.989702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:50.123746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:50.131918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59dcfd24-42d4-4cf7-8f42-160293609b6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.160986 Aug 29 20:22:50.132484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 448/878] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:49 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:51.154446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:51.155035 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:51.161458 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:51.161936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:51.162369 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:51.163716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:51.164166 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:51.164587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:51.292870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:51.300994 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-21e4e695-f009-40d5-a323-2c241c9b06bb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.150642 Aug 29 20:22:51.301550 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 431/879] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:51 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:51.934928 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:51.935441 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:51.941296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:51.941773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:51.942202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:51.942878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:51.943354 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:51.944373 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:52.024805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lazy-loading 'services' on Instance uuid a925ed9e-9777-434a-a778-395d0250e0e2 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:22:52.097122 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a78480e6-0b43-4bc6-8b0a-cca32ab34801 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2/os-volume_attachments/95c7142b-6fef-41c9-9e51-c4c0fd255f23" status: 202 len: 0 microversion: 2.1 time: 0.166070 Aug 29 20:22:52.097702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 449/880] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:22:51 2022] DELETE /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2/os-volume_attachments/95c7142b-6fef-41c9-9e51-c4c0fd255f23 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:22:52.321752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:52.322356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:52.328707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:52.329181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:52.329605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:52.330281 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:52.330731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:52.331182 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:52.462050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:52.471125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1b6111de-bd26-48d7-8f87-8414a3be6e8a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1730 microversion: 2.1 time: 0.153259 Aug 29 20:22:52.471683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 432/881] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:52 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:53.219922 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:53.220508 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:53.227861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.228342 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.228776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.229464 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.229919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.230340 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.255200 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:22:53.333377 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3a0aa03-65ec-456d-a3f6-b17f8911d3d1 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 204 len: 0 microversion: 2.1 time: 0.117825 Aug 29 20:22:53.334951 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 450/882] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:22:53 2022] DELETE /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:22:53.343299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:53.344529 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:53.351593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.352088 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.352527 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.353235 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.353696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.354130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.485445 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:53.492642 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:53.493339 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:53.494647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f94a8f75-7cbd-4715-aec7-a7741120c887 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1517 microversion: 2.1 time: 0.155581 Aug 29 20:22:53.495251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 433/883] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:53 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:53.499262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.499750 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.500185 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.500880 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.501345 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.501771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.635611 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:53.644134 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88e45767-e474-4e81-99fe-0bc024fc06ab tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1707 microversion: 2.1 time: 0.155722 Aug 29 20:22:53.645206 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 451/884] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:53 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1707 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:22:53.665388 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b8a7073c-36b3-4f70-a7b6-cbb92e467d9f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:53.671364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8a7073c-36b3-4f70-a7b6-cbb92e467d9f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.671855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8a7073c-36b3-4f70-a7b6-cbb92e467d9f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.672299 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b8a7073c-36b3-4f70-a7b6-cbb92e467d9f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.675861 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:53.696109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b8a7073c-36b3-4f70-a7b6-cbb92e467d9f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Going to try to start instance {{(pid=120721) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:22:53.738145 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b8a7073c-36b3-4f70-a7b6-cbb92e467d9f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action" status: 202 len: 0 microversion: 2.1 time: 0.076988 Aug 29 20:22:53.738745 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 434/885] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:22:53 2022] POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:22:53.747351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:53.747960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:53.753945 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.754430 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.754863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.755589 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:53.756092 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:53.756519 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:53.882618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:53.891180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44a4b7c1-65b0-4220-9b87-f104838dbc9a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1716 microversion: 2.1 time: 0.147667 Aug 29 20:22:53.891760 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 452/886] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:53 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:54.517904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:54.518607 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:54.525673 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:54.526157 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:54.526593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:54.527326 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:54.527794 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:54.528216 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:54.654753 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:54.662562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-95c6ce2a-bfd4-423a-bf45-cbfcf28d1d41 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1517 microversion: 2.1 time: 0.149204 Aug 29 20:22:54.663154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 435/887] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:54 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:54.913746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:54.914448 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:54.921100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:54.922335 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:54.922776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:54.923513 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:54.923968 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:54.924389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:55.057504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:55.065981 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-756771d5-f3f7-42b9-9856-8cd3b2d2b824 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1716 microversion: 2.1 time: 0.156139 Aug 29 20:22:55.066559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 453/888] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:54 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:55.683391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:55.683998 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:55.690222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:55.690709 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:55.691182 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:55.691881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:55.692339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:55.692777 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:55.845835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:55.856565 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9ccf399f-c842-421f-b3c9-6734960e7d75 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1517 microversion: 2.1 time: 0.176925 Aug 29 20:22:55.867033 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 436/889] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:55 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:55.926644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a402efcf-6be3-477e-860b-543e535b2783 req-eee7c9aa-6512-4dc1-9b73-eca2fcf6df1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a925ed9e-9777-434a-a778-395d0250e0e2", "name": "network-vif-deleted", "tag": "6080113a-f17e-4301-8c74-c101dde0273b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:22:55.936617 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a402efcf-6be3-477e-860b-543e535b2783 req-eee7c9aa-6512-4dc1-9b73-eca2fcf6df1f service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:55.937089 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a402efcf-6be3-477e-860b-543e535b2783 req-eee7c9aa-6512-4dc1-9b73-eca2fcf6df1f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:55.937509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a402efcf-6be3-477e-860b-543e535b2783 req-eee7c9aa-6512-4dc1-9b73-eca2fcf6df1f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:55.949051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a402efcf-6be3-477e-860b-543e535b2783 req-eee7c9aa-6512-4dc1-9b73-eca2fcf6df1f service nova] Creating event network-vif-deleted:6080113a-f17e-4301-8c74-c101dde0273b for instance a925ed9e-9777-434a-a778-395d0250e0e2 on hv-cinder-85426 Aug 29 20:22:55.954004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a402efcf-6be3-477e-860b-543e535b2783 req-eee7c9aa-6512-4dc1-9b73-eca2fcf6df1f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 Aug 29 20:22:55.954585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 454/890] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:22:56.087123 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:56.087755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:56.093768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:56.094323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:56.094838 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:56.095640 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:56.096546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:56.096700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:56.235453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:56.243661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-50983e85-815a-4fbf-a9b4-0f54cc11991d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1716 microversion: 2.1 time: 0.160810 Aug 29 20:22:56.244218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 437/891] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:56 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:56.879860 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:56.880924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:56.887722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:56.888214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:56.888916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:56.890447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:56.891057 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:56.891909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:56.926757 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:56.927657 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:56.928106 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:56.928572 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lazy-loading 'fault' on Instance uuid a925ed9e-9777-434a-a778-395d0250e0e2 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:22:56.970084 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:56.978902 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7724782-6130-412f-b248-559f6f18e3ff tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 200 len: 1312 microversion: 2.1 time: 0.104785 Aug 29 20:22:56.979553 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 455/892] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:56 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:57.265409 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:57.266125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:57.273253 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:57.273810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:57.274317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:57.275137 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:57.275673 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:57.276211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:57.405079 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:22:57.413284 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f3af045f-669a-4556-9154-c9b9dc7538c6 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1720 microversion: 2.1 time: 0.152299 Aug 29 20:22:57.413853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 438/893] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:57 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:22:57.999596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:22:58.000203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: a925ed9e-9777-434a-a778-395d0250e0e2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:22:58.007469 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:58.008191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:58.008694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:58.009401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:22:58.009866 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:22:58.010297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:22:58.024093 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] HTTP exception thrown: Instance a925ed9e-9777-434a-a778-395d0250e0e2 could not be found. Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Request method failure captured: Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 HTTP/1.1 Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR_j6Np10soPHfu1i7AA-ARUf2w3Tp1V9ad2TFRfoB8cuE4usT0MI8pjsmn1oimIIh_A0lrHfg0pvkHuqxCn2eMx_IY_U7OjamVuINnySIxM0vR5cJdv_Ut9_0UCbufP3kEuNLuidPEtGTGqLwUImgBrGo_t0sCaqoYLeF8UJCAXPT8 Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 04ea268b7d1f4d4185c1a69e8787de47 Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1935555621 Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:22:58.025734 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/04ea268b7d1f4d4185c1a69e8787de47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/04ea268b7d1f4d4185c1a69e8787de47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_04ea268b7d1f4d4185c1a69e8787de47", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/04ea268b7d1f4d4185c1a69e8787de47"}]}] Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotTestJSON-1935555621 Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 04ea268b7d1f4d4185c1a69e8787de47 Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1935555621 Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotTestJSON-1935555621-project Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 59c39a66e58b4dd89a8e7468ab352436 Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotTestJSON-1935555621-project Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance a925ed9e-9777-434a-a778-395d0250e0e2 could not be found. Aug 29 20:22:58.027346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'a925ed9e-9777-434a-a778-395d0250e0e2'} Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a925ed9e-9777-434a-a778-395d0250e0e2 could not be found. Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:22:58.028214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a925ed9e-9777-434a-a778-395d0250e0e2 could not be found. Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a925ed9e-9777-434a-a778-395d0250e0e2 could not be found. Aug 29 20:22:58.029515 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:22:58.030641 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Returning 404 to user: Instance a925ed9e-9777-434a-a778-395d0250e0e2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:22:58.030641 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a78e93c-601e-40fe-b411-975bd60a9dce tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2" status: 404 len: 111 microversion: 2.1 time: 0.031381 Aug 29 20:22:58.030641 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 456/894] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:22:57 2022] GET /compute/v2.1/servers/a925ed9e-9777-434a-a778-395d0250e0e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:07.908718 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-204617680", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "networks": [{"uuid": "1ec36a05-6a5a-484d-a939-2db44f4b4d4f"}]}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:07.918042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=38 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.918705 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.965736 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] validate_networks() for [('1ec36a05-6a5a-484d-a939-2db44f4b4d4f', None, None, None, None, None)] {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:23:08.313435 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:23:08.313860 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:23:08.314693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:23:08.314693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:23:08.315462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:23:08.324451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:08.324871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:08.325297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:08.326009 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:08.326457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:08.326872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:08.343918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Getting quotas for project 04ea268b7d1f4d4185c1a69e8787de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:23:08.347798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Getting quotas for user 59c39a66e58b4dd89a8e7468ab352436 and project 04ea268b7d1f4d4185c1a69e8787de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:23:08.358410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:23:08.360703 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:23:08.406555 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2638aa6c-09b5-4886-bb04-3606b78388e8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.501590 Aug 29 20:23:08.407218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 439/895] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:23:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:23:08.418106 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58528676-d406-42ac-946c-8255b28010fc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:08.418708 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58528676-d406-42ac-946c-8255b28010fc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:08.421411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:08.422156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:08.480677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58528676-d406-42ac-946c-8255b28010fc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:08.487620 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58528676-d406-42ac-946c-8255b28010fc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1222 microversion: 2.1 time: 0.073376 Aug 29 20:23:08.488178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 457/896] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:08 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:09.509764 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:09.510365 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:09.517133 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:09.517608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:09.518036 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:09.518722 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:09.519215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:09.519635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:09.583181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:09.591823 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-265e85fb-4b57-4d98-ad0d-0bfe70ff1d42 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1274 microversion: 2.1 time: 0.087237 Aug 29 20:23:09.592398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 440/897] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:09 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:10.613066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:10.614239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:10.622284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:10.622772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:10.623243 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:10.623942 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:10.624401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:10.624826 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:10.756702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:10.764949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1533bff4-3c37-4604-9ac9-5ea17009aa6b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1322 microversion: 2.1 time: 0.155831 Aug 29 20:23:10.765518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 458/898] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:10 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:10.797179 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-4cefc046-a48c-48fb-b526-f4773c5ecfcb req-09ee8aec-96ff-4f20-ad16-f0b351e8b3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ff1435-5e21-4226-9374-85ba7b6a7932", "tag": "50d5a333-df3c-4c4f-a882-210923470129"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:10.807742 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4cefc046-a48c-48fb-b526-f4773c5ecfcb req-09ee8aec-96ff-4f20-ad16-f0b351e8b3c1 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:10.808228 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4cefc046-a48c-48fb-b526-f4773c5ecfcb req-09ee8aec-96ff-4f20-ad16-f0b351e8b3c1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:10.808659 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4cefc046-a48c-48fb-b526-f4773c5ecfcb req-09ee8aec-96ff-4f20-ad16-f0b351e8b3c1 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:10.820800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-4cefc046-a48c-48fb-b526-f4773c5ecfcb req-09ee8aec-96ff-4f20-ad16-f0b351e8b3c1 service nova] Creating event network-changed:50d5a333-df3c-4c4f-a882-210923470129 for instance e1ff1435-5e21-4226-9374-85ba7b6a7932 on hv-cinder-85426 Aug 29 20:23:10.826228 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-4cefc046-a48c-48fb-b526-f4773c5ecfcb req-09ee8aec-96ff-4f20-ad16-f0b351e8b3c1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032648 Aug 29 20:23:10.827218 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 441/899] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:11.785572 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:11.786173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:11.793004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:11.793488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:11.793918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:11.794602 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:11.795052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:11.795499 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:11.926263 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:11.934458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32fb08d1-6592-48b5-8e0b-4793168d398f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1322 microversion: 2.1 time: 0.152739 Aug 29 20:23:11.935020 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 459/900] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:11 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:12.956198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:12.956887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:12.963528 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:12.964009 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:12.964440 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:12.965123 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:12.965581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:12.966000 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:13.095281 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:13.102730 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e5ab3359-307d-4d9f-86af-d08f4a2af5dc tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1322 microversion: 2.1 time: 0.151167 Aug 29 20:23:13.103518 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 442/901] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:12 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:14.124010 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:14.124756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:14.131392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:14.131878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:14.132311 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:14.133679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:14.134145 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:14.134612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:14.261797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:14.269390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd18eb0e-7830-4873-8f4c-bc5f16b13fed tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1322 microversion: 2.1 time: 0.149516 Aug 29 20:23:14.269962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 460/902] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:14 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:15.263804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-e19e442b-0215-40d3-b938-cfed90b5e7e9 req-4d67c6ea-f593-4e42-91f4-2869163698d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ff1435-5e21-4226-9374-85ba7b6a7932", "name": "network-vif-plugged", "status": "completed", "tag": "50d5a333-df3c-4c4f-a882-210923470129"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:15.274833 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e19e442b-0215-40d3-b938-cfed90b5e7e9 req-4d67c6ea-f593-4e42-91f4-2869163698d7 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:15.275349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e19e442b-0215-40d3-b938-cfed90b5e7e9 req-4d67c6ea-f593-4e42-91f4-2869163698d7 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:15.275775 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e19e442b-0215-40d3-b938-cfed90b5e7e9 req-4d67c6ea-f593-4e42-91f4-2869163698d7 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:15.287121 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-e19e442b-0215-40d3-b938-cfed90b5e7e9 req-4d67c6ea-f593-4e42-91f4-2869163698d7 service nova] Creating event network-vif-plugged:50d5a333-df3c-4c4f-a882-210923470129 for instance e1ff1435-5e21-4226-9374-85ba7b6a7932 on hv-cinder-85426 Aug 29 20:23:15.290059 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:15.290747 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:15.292070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-e19e442b-0215-40d3-b938-cfed90b5e7e9 req-4d67c6ea-f593-4e42-91f4-2869163698d7 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Aug 29 20:23:15.292896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 443/903] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:15.297108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:15.297662 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:15.298351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:15.299145 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:15.299764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:15.300385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:15.446110 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:15.453754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d6529306-6898-4845-9fe2-6d96affa3579 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1322 microversion: 2.1 time: 0.167826 Aug 29 20:23:15.454317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 461/904] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:15 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:16.475825 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:16.476523 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:16.482568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:16.483088 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:16.483521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:16.484206 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:16.484662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:16.485085 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:16.616442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:16.625226 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1250dcdf-1a15-4537-b885-dd96cbed1c4d tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1322 microversion: 2.1 time: 0.154059 Aug 29 20:23:16.625933 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 444/905] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:16 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:17.646526 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:17.647156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:17.654129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.654610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.655049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:17.655756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.656211 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.656634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:17.786887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:17.794886 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-51efcd9a-d9fb-418a-a808-612d5f5f5641 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1512 microversion: 2.1 time: 0.152212 Aug 29 20:23:17.795484 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 462/906] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:17 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:17.815846 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02668ae5-e02b-472e-b8ec-98cb1552f10f", "device": "/dev/sdb"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:17.818203 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:17.825110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.825594 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.826029 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:17.826714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:17.827198 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:17.827623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:18.063292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-64a5f084-6959-470f-9595-71ab173264eb tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "POST /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251151 Aug 29 20:23:18.064242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 445/907] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:23:17 2022] POST /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:24.738475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:24.738980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:24.742605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-dbe6eb05-a377-42f5-aea8-5436c7371142 req-7144d642-6364-46ab-a896-69f23906497d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83bcf88-8091-4f8d-a4da-70fca97f998b", "tag": "7d6824a3-3f0a-45bd-a07c-4410609d94de"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:24.745093 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:24.746921 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.747452 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.748231 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:24.748398 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:24.749339 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.749457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:24.750107 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.750773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:24.755960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-dbe6eb05-a377-42f5-aea8-5436c7371142 req-7144d642-6364-46ab-a896-69f23906497d service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.756439 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-dbe6eb05-a377-42f5-aea8-5436c7371142 req-7144d642-6364-46ab-a896-69f23906497d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.756864 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-dbe6eb05-a377-42f5-aea8-5436c7371142 req-7144d642-6364-46ab-a896-69f23906497d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:24.770018 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-dbe6eb05-a377-42f5-aea8-5436c7371142 req-7144d642-6364-46ab-a896-69f23906497d service nova] Creating event network-changed:7d6824a3-3f0a-45bd-a07c-4410609d94de for instance b83bcf88-8091-4f8d-a4da-70fca97f998b on hv-cinder-85426 Aug 29 20:23:24.775285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-dbe6eb05-a377-42f5-aea8-5436c7371142 req-7144d642-6364-46ab-a896-69f23906497d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037570 Aug 29 20:23:24.775884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 446/908] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:24.779523 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:23:24.877971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-158bc5a1-b37d-4d55-b6e8-323a2d8ce5e3 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "DELETE /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 204 len: 0 microversion: 2.1 time: 0.142851 Aug 29 20:23:24.879221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 463/909] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:23:24 2022] DELETE /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:23:24.889541 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:24.890349 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:24.899689 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.900285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.900795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:24.901690 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:24.902227 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:24.902724 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:25.045235 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:25.053379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-96d59c4e-5582-44e5-bb78-e0dc7a79ee39 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1578 microversion: 2.1 time: 0.169063 Aug 29 20:23:25.054745 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 447/910] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:24 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:26.076411 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:26.077031 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:26.083871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:26.084348 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:26.084785 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:26.086130 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:26.086598 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:26.087028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:26.222182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:26.229913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82294638-56f7-4f4d-acea-aef699bf880d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1578 microversion: 2.1 time: 0.157873 Aug 29 20:23:26.230487 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 464/911] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:26 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:27.251756 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:27.252361 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:27.259347 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:27.259910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:27.260599 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:27.261281 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:27.261731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:27.262149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:27.394176 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:27.402545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2ad931a1-9521-4d89-b395-5947c6d58df1 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1578 microversion: 2.1 time: 0.154572 Aug 29 20:23:27.403183 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 448/912] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:27 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:28.424014 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:28.424619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:28.431736 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:28.432221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:28.432657 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:28.433346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:28.433803 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:28.434227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:28.568042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:28.576415 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e15b41a-19c2-4ff9-a6c7-4b35ba4aa0e6 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1578 microversion: 2.1 time: 0.156199 Aug 29 20:23:28.576925 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 465/913] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:28 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:29.597405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:29.598012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:29.604641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:29.605128 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:29.605561 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:29.606261 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:29.606714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:29.607161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:29.736871 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:29.744693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7b451002-d439-441e-adc3-d85aa8504203 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1460 microversion: 2.1 time: 0.151142 Aug 29 20:23:29.745272 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 449/914] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:29 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1460 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:30.228979 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-da136dbc-f2d8-4570-8c75-f23dca806f08 req-6d5cbc48-831e-43cb-9b9c-0f54bc0a545a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83bcf88-8091-4f8d-a4da-70fca97f998b", "name": "network-vif-deleted", "tag": "7d6824a3-3f0a-45bd-a07c-4410609d94de"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:30.238971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-da136dbc-f2d8-4570-8c75-f23dca806f08 req-6d5cbc48-831e-43cb-9b9c-0f54bc0a545a service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.239457 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-da136dbc-f2d8-4570-8c75-f23dca806f08 req-6d5cbc48-831e-43cb-9b9c-0f54bc0a545a service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.239862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-da136dbc-f2d8-4570-8c75-f23dca806f08 req-6d5cbc48-831e-43cb-9b9c-0f54bc0a545a service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.402354 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-da136dbc-f2d8-4570-8c75-f23dca806f08 req-6d5cbc48-831e-43cb-9b9c-0f54bc0a545a service nova] Creating event network-vif-deleted:7d6824a3-3f0a-45bd-a07c-4410609d94de for instance b83bcf88-8091-4f8d-a4da-70fca97f998b on hv-cinder-85426 Aug 29 20:23:30.407512 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-da136dbc-f2d8-4570-8c75-f23dca806f08 req-6d5cbc48-831e-43cb-9b9c-0f54bc0a545a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182628 Aug 29 20:23:30.408212 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 466/915] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:30.766067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:30.766670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:30.776013 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.776493 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.776924 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.777613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:30.778064 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:30.778481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:30.845953 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:30.855824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-565756b3-ea28-407d-bdcf-4b22d1a22f95 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1228 microversion: 2.1 time: 0.093560 Aug 29 20:23:30.856393 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 450/916] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:30 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:31.889097 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:31.889680 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:31.896124 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:31.896275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:31.896698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:31.898052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:31.898503 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:31.898922 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:31.962758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:31.970371 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-878e6149-747b-4dca-9265-5692f5425567 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1228 microversion: 2.1 time: 0.086346 Aug 29 20:23:31.970909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 467/917] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:31 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:32.989781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:32.990385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:32.997190 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.997667 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.998098 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:32.998819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:32.999273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:32.999693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:33.062169 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:33.070381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-b0e50fbe-065b-413f-9be0-077abe2bcfc4 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1228 microversion: 2.1 time: 0.084417 Aug 29 20:23:33.070963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 451/918] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:32 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:34.091924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:34.092440 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:34.099180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:34.099672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:34.100103 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:34.100839 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:34.101294 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:34.101718 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:34.135824 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:34.136375 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:34.136809 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:34.137261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lazy-loading 'fault' on Instance uuid b83bcf88-8091-4f8d-a4da-70fca97f998b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:34.183575 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:34.191478 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0bbae9c5-1384-45cc-97f1-dfd870d4140d tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 200 len: 1233 microversion: 2.1 time: 0.103370 Aug 29 20:23:34.203116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 468/919] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:34 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 1233 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:35.219105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:35.219769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: b83bcf88-8091-4f8d-a4da-70fca97f998b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:35.226896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:35.227402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:35.227841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:35.228532 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:35.228988 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:35.229413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:35.243047 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] HTTP exception thrown: Instance b83bcf88-8091-4f8d-a4da-70fca97f998b could not be found. Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Request method failure captured: Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b HTTP/1.1 Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR5YgW2cmFa4Iet_8Z0UZR6G6fVnx_1aT6R_5OK1bDl31lceZ1waDTgzL-Yc6vobv0CKAx4BvDbdhIMLVfTiBonU6SoeXTMEZv5NXRaAk5CucfEGQWpEP8PSDCxJ87xkUcuNMi1xw6lMSfLn2v7BXX5QF2cJPfDdvEIVGOY7zrnscV4 Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:23:35.245104 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c6be9a9db45a423c9f4baec61d3e0228", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}] Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: a94af170fb414928970e7353964e31c0 Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance b83bcf88-8091-4f8d-a4da-70fca97f998b could not be found. Aug 29 20:23:35.246546 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': 'b83bcf88-8091-4f8d-a4da-70fca97f998b'} Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83bcf88-8091-4f8d-a4da-70fca97f998b could not be found. Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:35.247379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83bcf88-8091-4f8d-a4da-70fca97f998b could not be found. Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83bcf88-8091-4f8d-a4da-70fca97f998b could not be found. Aug 29 20:23:35.248641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:35.249777 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Returning 404 to user: Instance b83bcf88-8091-4f8d-a4da-70fca97f998b could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:35.249777 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-461e0e9f-8768-442e-883e-af777dee6301 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b" status: 404 len: 111 microversion: 2.1 time: 0.032280 Aug 29 20:23:35.249777 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 452/920] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:35 2022] GET /compute/v2.1/servers/b83bcf88-8091-4f8d-a4da-70fca97f998b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:37.495159 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:37.495696 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:37.501975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:37.502466 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:37.502901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:37.503623 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:37.504079 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:37.504542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:37.589706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lazy-loading 'services' on Instance uuid e1ff1435-5e21-4226-9374-85ba7b6a7932 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:37.662689 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c805efac-4bf7-4f22-ab66-d0cf957ffd8b tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "DELETE /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932/os-volume_attachments/02668ae5-e02b-472e-b8ec-98cb1552f10f" status: 202 len: 0 microversion: 2.1 time: 0.171769 Aug 29 20:23:37.663311 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 469/921] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:23:37 2022] DELETE /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932/os-volume_attachments/02668ae5-e02b-472e-b8ec-98cb1552f10f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:23:38.355273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:38.355833 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:38.358589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:38.358741 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-68106d14-c6d3-4147-9a8b-277981f151de req-ae890a0b-72fb-4a6c-8b95-71ca4dda6523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ef443f-53dc-4751-a283-a8a4bbe30704", "tag": "fed44f86-4ac1-400d-89f5-f2f62741117b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:38.365204 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.365854 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.366357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.367116 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.367867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.368482 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.373477 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-68106d14-c6d3-4147-9a8b-277981f151de req-ae890a0b-72fb-4a6c-8b95-71ca4dda6523 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.373807 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:38.375540 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-68106d14-c6d3-4147-9a8b-277981f151de req-ae890a0b-72fb-4a6c-8b95-71ca4dda6523 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.376107 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-68106d14-c6d3-4147-9a8b-277981f151de req-ae890a0b-72fb-4a6c-8b95-71ca4dda6523 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.399447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-68106d14-c6d3-4147-9a8b-277981f151de req-ae890a0b-72fb-4a6c-8b95-71ca4dda6523 service nova] Creating event network-changed:fed44f86-4ac1-400d-89f5-f2f62741117b for instance 56ef443f-53dc-4751-a283-a8a4bbe30704 on hv-cinder-85426 Aug 29 20:23:38.399703 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:23:38.412663 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-68106d14-c6d3-4147-9a8b-277981f151de req-ae890a0b-72fb-4a6c-8b95-71ca4dda6523 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058120 Aug 29 20:23:38.421885 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 470/922] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:23:38.512831 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4f86e645-a034-44cc-83d5-ea5a8a870b46 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "DELETE /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 204 len: 0 microversion: 2.1 time: 0.161778 Aug 29 20:23:38.513490 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 453/923] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:23:38 2022] DELETE /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:23:38.523805 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:38.524636 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:38.526787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:38.532167 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.532652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.533081 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.533783 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.534237 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.534673 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.538414 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:38.673089 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:38.682188 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78690821-7224-4bc8-a1ed-028244be5d99 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1580 microversion: 2.1 time: 0.163836 Aug 29 20:23:38.682863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 471/924] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:38 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:38.784116 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:38.784714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:38.790560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.791045 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.791511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.792203 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.792659 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.793079 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.818002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:23:38.897227 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-070cd6fa-18f5-43fd-a1fc-c82224974b2f tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "DELETE /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 204 len: 0 microversion: 2.1 time: 0.116979 Aug 29 20:23:38.897903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 454/925] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:23:38 2022] DELETE /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:23:38.906182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:38.906873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:38.913200 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.913769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.914204 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:38.914910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:38.915401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:38.915831 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.052321 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:39.060958 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc32ddc6-7976-43e8-af10-ffddc9cbcad3 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1518 microversion: 2.1 time: 0.158713 Aug 29 20:23:39.061529 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 472/926] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:38 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:39.705024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:39.705774 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:39.712556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.713042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.713522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.714223 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:39.714685 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:39.715136 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:39.864089 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:39.873706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3b91ff12-80a7-4910-b45e-6ad17eab1dfd tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1580 microversion: 2.1 time: 0.172814 Aug 29 20:23:39.874381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 455/927] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:39 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1580 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:40.085706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:40.086253 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:40.092674 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.093156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.093595 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.094289 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.094743 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.095198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.228186 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:40.237752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d551ace-efc5-492f-bd81-d429ff5ccaf8 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1518 microversion: 2.1 time: 0.156163 Aug 29 20:23:40.238434 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 473/928] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:40 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:40.896202 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:40.896814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:40.903832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.904320 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.904752 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:40.905442 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:40.905923 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:40.906350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:41.034707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:41.043021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3974da31-9238-4dda-9283-ce234e015fab tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1580 microversion: 2.1 time: 0.150623 Aug 29 20:23:41.043609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 456/929] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:40 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:41.259289 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:41.260151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:41.266485 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:41.266969 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:41.267437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:41.268123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:41.268576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:41.268997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:41.402912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:41.410470 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-089d1960-0d8e-4e70-abc2-6cf4cdcfcd12 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1518 microversion: 2.1 time: 0.155127 Aug 29 20:23:41.411029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 474/930] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:41 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:42.064985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:42.065588 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:42.072724 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.073208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.073641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.074331 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.074783 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.075229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.206961 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:42.214648 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-42d6a229-9df8-4897-84bc-6c7c68daed77 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1580 microversion: 2.1 time: 0.153916 Aug 29 20:23:42.215244 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 457/931] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:42 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:42.432869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:42.433587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:42.440563 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.440563 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.440863 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.441428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.443514 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.443514 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.579587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:42.588493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73a0f27f-9167-4215-a542-0313ad91bf78 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1518 microversion: 2.1 time: 0.160613 Aug 29 20:23:42.589072 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 475/932] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:42 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:42.719259 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-1b8afb59-6e92-49d8-80a1-959c238e41c1 req-77c1ba64-5164-497a-b28b-7d2f73db6e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ef443f-53dc-4751-a283-a8a4bbe30704", "name": "network-vif-deleted", "tag": "fed44f86-4ac1-400d-89f5-f2f62741117b"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:42.731706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1b8afb59-6e92-49d8-80a1-959c238e41c1 req-77c1ba64-5164-497a-b28b-7d2f73db6e23 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.733205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1b8afb59-6e92-49d8-80a1-959c238e41c1 req-77c1ba64-5164-497a-b28b-7d2f73db6e23 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.734065 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-1b8afb59-6e92-49d8-80a1-959c238e41c1 req-77c1ba64-5164-497a-b28b-7d2f73db6e23 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.736075 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:42.736600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:42.743703 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.744299 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.744874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.745679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:42.745994 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:42.746496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:42.753881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-1b8afb59-6e92-49d8-80a1-959c238e41c1 req-77c1ba64-5164-497a-b28b-7d2f73db6e23 service nova] Creating event network-vif-deleted:fed44f86-4ac1-400d-89f5-f2f62741117b for instance 56ef443f-53dc-4751-a283-a8a4bbe30704 on hv-cinder-85426 Aug 29 20:23:42.760586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-1b8afb59-6e92-49d8-80a1-959c238e41c1 req-77c1ba64-5164-497a-b28b-7d2f73db6e23 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045375 Aug 29 20:23:42.761313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 458/933] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:42.837782 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lazy-loading 'services' on Instance uuid 3e1b5faf-7e07-4876-9370-ad143689d94d {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:42.916536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3960af26-6848-4de7-a3ac-8d38d2ee4954 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-volume_attachments/a977a305-e8a9-4a57-8b1b-668439d1f9a8" status: 202 len: 0 microversion: 2.1 time: 0.184645 Aug 29 20:23:42.917152 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 476/934] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:23:42 2022] DELETE /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-volume_attachments/a977a305-e8a9-4a57-8b1b-668439d1f9a8 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:23:43.237789 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:43.238410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:43.244522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.245001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.245436 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.246116 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.246571 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.246987 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.278287 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.278765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.279324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.280867 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lazy-loading 'fault' on Instance uuid 56ef443f-53dc-4751-a283-a8a4bbe30704 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:43.330212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94af170fb414928970e7353964e31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be9a9db45a423c9f4baec61d3e0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:43.339224 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e04c6197-52c0-405b-ad6c-7b30ce5e7932 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 200 len: 1233 microversion: 2.1 time: 0.106151 Aug 29 20:23:43.339804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 459/935] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:43 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 1233 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:43.612220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:43.613391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:43.621191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.621678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.622139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.622835 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.623326 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.623747 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.657937 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:43.658437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:43.658877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:43.659351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lazy-loading 'fault' on Instance uuid e1ff1435-5e21-4226-9374-85ba7b6a7932 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:23:43.712447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c39a66e58b4dd89a8e7468ab352436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ea268b7d1f4d4185c1a69e8787de47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:43.721171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-62486a74-088d-44a4-bc1e-aafc91dcda6c tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 200 len: 1312 microversion: 2.1 time: 0.113484 Aug 29 20:23:43.733542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 477/936] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:43 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:44.049201 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-044fe90f-5147-4579-84d2-deaf4ed7f4e4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:44.061178 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044fe90f-5147-4579-84d2-deaf4ed7f4e4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.061801 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044fe90f-5147-4579-84d2-deaf4ed7f4e4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.062236 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-044fe90f-5147-4579-84d2-deaf4ed7f4e4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.085459 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-044fe90f-5147-4579-84d2-deaf4ed7f4e4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Going to try to stop instance {{(pid=120721) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:23:44.127934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-044fe90f-5147-4579-84d2-deaf4ed7f4e4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action" status: 202 len: 0 microversion: 2.1 time: 0.082743 Aug 29 20:23:44.131877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 460/937] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:23:44 2022] POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:23:44.137391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:44.139014 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:44.145561 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.146063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.146508 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.147290 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.148401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.148828 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.280041 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:44.287840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce1253ce-5495-48d8-aa6e-0748daa7d524 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.154682 Aug 29 20:23:44.289026 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 478/938] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:44 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:44.363804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:44.364889 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: 56ef443f-53dc-4751-a283-a8a4bbe30704] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:44.371185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.371669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.372099 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.372785 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.373239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.373656 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.387311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] HTTP exception thrown: Instance 56ef443f-53dc-4751-a283-a8a4bbe30704 could not be found. Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Request method failure captured: Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 HTTP/1.1 Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR5YgW2cmFa4Iet_8Z0UZR6G6fVnx_1aT6R_5OK1bDl31lceZ1waDTgzL-Yc6vobv0CKAx4BvDbdhIMLVfTiBonU6SoeXTMEZv5NXRaAk5CucfEGQWpEP8PSDCxJ87xkUcuNMi1xw6lMSfLn2v7BXX5QF2cJPfDdvEIVGOY7zrnscV4 Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:23:44.388848 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c6be9a9db45a423c9f4baec61d3e0228", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}] Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: a94af170fb414928970e7353964e31c0 Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 56ef443f-53dc-4751-a283-a8a4bbe30704 could not be found. Aug 29 20:23:44.390503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '56ef443f-53dc-4751-a283-a8a4bbe30704'} Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ef443f-53dc-4751-a283-a8a4bbe30704 could not be found. Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:44.391469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ef443f-53dc-4751-a283-a8a4bbe30704 could not be found. Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ef443f-53dc-4751-a283-a8a4bbe30704 could not be found. Aug 29 20:23:44.393078 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.394549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Returning 404 to user: Instance 56ef443f-53dc-4751-a283-a8a4bbe30704 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:44.394549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-970dc6b2-8e69-44ea-8a90-843fce81e27a tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704" status: 404 len: 111 microversion: 2.1 time: 0.032205 Aug 29 20:23:44.394549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 461/939] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:44 2022] GET /compute/v2.1/servers/56ef443f-53dc-4751-a283-a8a4bbe30704 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:44.743524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:44.744134 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] [instance: e1ff1435-5e21-4226-9374-85ba7b6a7932] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:44.750577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.751063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.751534 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.752235 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.752695 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.753121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.768146 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] HTTP exception thrown: Instance e1ff1435-5e21-4226-9374-85ba7b6a7932 could not be found. Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Request method failure captured: Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 HTTP/1.1 Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR_j6Np10soPHfu1i7AA-ARUf2w3Tp1V9ad2TFRfoB8cuE4usT0MI8pjsmn1oimIIh_A0lrHfg0pvkHuqxCn2eMx_IY_U7OjamVuINnySIxM0vR5cJdv_Ut9_0UCbufP3kEuNLuidPEtGTGqLwUImgBrGo_t0sCaqoYLeF8UJCAXPT8 Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 04ea268b7d1f4d4185c1a69e8787de47 Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1935555621 Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:23:44.769877 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/04ea268b7d1f4d4185c1a69e8787de47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/04ea268b7d1f4d4185c1a69e8787de47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_04ea268b7d1f4d4185c1a69e8787de47", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/04ea268b7d1f4d4185c1a69e8787de47"}]}] Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotTestJSON-1935555621 Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 04ea268b7d1f4d4185c1a69e8787de47 Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1935555621 Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotTestJSON-1935555621-project Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: 59c39a66e58b4dd89a8e7468ab352436 Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotTestJSON-1935555621-project Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance e1ff1435-5e21-4226-9374-85ba7b6a7932 could not be found. Aug 29 20:23:44.771410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'e1ff1435-5e21-4226-9374-85ba7b6a7932'} Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ff1435-5e21-4226-9374-85ba7b6a7932 could not be found. Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:44.772195 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ff1435-5e21-4226-9374-85ba7b6a7932 could not be found. Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ff1435-5e21-4226-9374-85ba7b6a7932 could not be found. Aug 29 20:23:44.774052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.775336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] Returning 404 to user: Instance e1ff1435-5e21-4226-9374-85ba7b6a7932 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:44.775336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0787680c-6402-4783-9603-4c848601d838 tempest-VolumesSnapshotTestJSON-1935555621 tempest-VolumesSnapshotTestJSON-1935555621-project] 10.222.0.121 "GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932" status: 404 len: 111 microversion: 2.1 time: 0.031697 Aug 29 20:23:44.783111 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-a67c4654-ef70-4945-a8d2-55227ff6878f req-4389f69a-445f-4ba0-b64b-e6642687e9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ff1435-5e21-4226-9374-85ba7b6a7932", "name": "network-vif-deleted", "tag": "50d5a333-df3c-4c4f-a882-210923470129"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:23:44.783461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 479/940] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:44 2022] GET /compute/v2.1/servers/e1ff1435-5e21-4226-9374-85ba7b6a7932 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:44.787744 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a67c4654-ef70-4945-a8d2-55227ff6878f req-4389f69a-445f-4ba0-b64b-e6642687e9c8 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.788186 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a67c4654-ef70-4945-a8d2-55227ff6878f req-4389f69a-445f-4ba0-b64b-e6642687e9c8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.788626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-a67c4654-ef70-4945-a8d2-55227ff6878f req-4389f69a-445f-4ba0-b64b-e6642687e9c8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.800617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-a67c4654-ef70-4945-a8d2-55227ff6878f req-4389f69a-445f-4ba0-b64b-e6642687e9c8 service nova] Creating event network-vif-deleted:50d5a333-df3c-4c4f-a882-210923470129 for instance e1ff1435-5e21-4226-9374-85ba7b6a7932 on hv-cinder-85426 Aug 29 20:23:44.805526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-a67c4654-ef70-4945-a8d2-55227ff6878f req-4389f69a-445f-4ba0-b64b-e6642687e9c8 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033599 Aug 29 20:23:44.806125 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 462/941] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:23:44.837229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:44.837812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:44.847150 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.847651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.849564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.850298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.850983 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.851441 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.865870 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] HTTP exception thrown: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Request method failure captured: Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 HTTP/1.1 Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR5YgW2cmFa4Iet_8Z0UZR6G6fVnx_1aT6R_5OK1bDl31lceZ1waDTgzL-Yc6vobv0CKAx4BvDbdhIMLVfTiBonU6SoeXTMEZv5NXRaAk5CucfEGQWpEP8PSDCxJ87xkUcuNMi1xw6lMSfLn2v7BXX5QF2cJPfDdvEIVGOY7zrnscV4 Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:23:44.867988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c6be9a9db45a423c9f4baec61d3e0228", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}] Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: a94af170fb414928970e7353964e31c0 Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.869577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'af99cf2b-b549-400f-bad3-1bf633c6a2c4'} Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:44.870511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.871754 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.873062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Returning 404 to user: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:44.873062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae83e5d3-e93d-4feb-bd9b-34dc09ac4c3f tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "DELETE /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 404 len: 111 microversion: 2.1 time: 0.036712 Aug 29 20:23:44.873062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 480/942] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:23:44 2022] DELETE /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:44.878903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:44.881509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [instance: af99cf2b-b549-400f-bad3-1bf633c6a2c4] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:44.888524 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.889007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.889818 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.890115 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:44.890566 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:44.891008 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:44.904519 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] HTTP exception thrown: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Request method failure captured: Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 HTTP/1.1 Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR5YgW2cmFa4Iet_8Z0UZR6G6fVnx_1aT6R_5OK1bDl31lceZ1waDTgzL-Yc6vobv0CKAx4BvDbdhIMLVfTiBonU6SoeXTMEZv5NXRaAk5CucfEGQWpEP8PSDCxJ87xkUcuNMi1xw6lMSfLn2v7BXX5QF2cJPfDdvEIVGOY7zrnscV4 Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:23:44.906162 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c6be9a9db45a423c9f4baec61d3e0228", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c6be9a9db45a423c9f4baec61d3e0228"}]}] Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: c6be9a9db45a423c9f4baec61d3e0228 Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-TestVolumeBootPattern-2079008293 Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: a94af170fb414928970e7353964e31c0 Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-TestVolumeBootPattern-2079008293-project Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.907761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': 'af99cf2b-b549-400f-bad3-1bf633c6a2c4'} Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:23:44.908579 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. Aug 29 20:23:44.909845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:23:44.911007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Returning 404 to user: Instance af99cf2b-b549-400f-bad3-1bf633c6a2c4 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:23:44.911007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d7f4789b-8a8c-40e6-b86c-63ed2566b891 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4" status: 404 len: 111 microversion: 2.1 time: 0.032967 Aug 29 20:23:44.911007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 463/943] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:44 2022] GET /compute/v2.1/servers/af99cf2b-b549-400f-bad3-1bf633c6a2c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:23:45.309735 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:45.310443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:45.317294 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:45.317913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:45.318274 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:45.319118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:45.319887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:45.319887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:45.459615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:45.470524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e5c5e82-5413-4002-add3-b0c420b18b5a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.164736 Aug 29 20:23:45.471120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 481/944] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:45 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:46.229672 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0d2fd6bc-688b-4ca9-901a-4a50751f1d17 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] Calling method '.version_select at 0x7f446955d4c0>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:46.235026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d2fd6bc-688b-4ca9-901a-4a50751f1d17 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [348d9784-4851-4315-a2cc-edaaac08542a] AMQP server on 10.222.0.121:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 20:23:46.493847 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:46.494443 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:46.500864 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.501331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.501764 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.502451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:46.502903 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:46.503358 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:46.632654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:46.640759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-917aa7a6-4ed1-46b6-b989-80e8298e68b5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.151288 Aug 29 20:23:46.641317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 482/945] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:46 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:23:47.243550 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d2fd6bc-688b-4ca9-901a-4a50751f1d17 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] [348d9784-4851-4315-a2cc-edaaac08542a] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 54826. Aug 29 20:23:47.263122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0d2fd6bc-688b-4ca9-901a-4a50751f1d17 tempest-TestVolumeBootPattern-2079008293 tempest-TestVolumeBootPattern-2079008293-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-493868041" status: 202 len: 0 microversion: 2.1 time: 1.037178 Aug 29 20:23:47.263696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 464/946] 10.222.0.121 () {58 vars in 1265 bytes} [Mon Aug 29 20:23:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-493868041 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:23:47.664390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:47.665008 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:47.671032 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:47.671566 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:47.672008 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:47.672724 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:47.673220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:47.673653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:47.884873 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:47.893228 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5040cd31-a2d1-473a-a436-6ea6312e3225 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.234706 Aug 29 20:23:47.893808 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 483/947] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:47 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:48.915043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:48.915881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:48.923520 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.924013 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.924453 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:48.925158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:48.925768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:48.926150 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:49.167682 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:49.175387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-28455bce-aa78-459b-b4e7-68da3ac38fd0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.265017 Aug 29 20:23:49.176406 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 465/948] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:48 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:50.200909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:50.202437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:50.213665 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:50.214519 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:50.215207 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:50.216150 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:50.216847 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:50.217610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:50.447492 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:50.478076 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-427102ab-18cf-4f19-8433-b1bf18c87884 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.282461 Aug 29 20:23:50.479063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 484/949] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:50 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:51.499051 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:51.499979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:51.507661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.508181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.508630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.509597 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:51.510073 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:51.510530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:51.646999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:51.654950 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6f4e4674-da92-4b1e-a4b8-e98475d46959 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.159931 Aug 29 20:23:51.655547 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 466/950] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:51 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:52.676660 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:52.677404 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:52.683916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.684960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.685496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.686318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:52.686874 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:52.687421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:52.837381 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:52.846655 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23de4ec2-9625-4cbf-ae21-846ee1397f5c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.174183 Aug 29 20:23:52.859596 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 485/951] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:52 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:53.868693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:53.869310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:53.880324 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:53.881164 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:53.883855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:53.884967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:53.885572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:53.886289 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:54.234175 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:54.243052 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ab9721e3-5192-4b17-a903-40b8dcc105d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.378746 Aug 29 20:23:54.243652 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 467/952] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:53 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:55.264644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:55.265214 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:55.272239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:55.272745 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:55.273186 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:55.273916 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:55.274385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:55.274822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:55.609410 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:55.617053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74c414c7-3f04-4e3b-82e7-21c714387183 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.356451 Aug 29 20:23:55.617616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 486/953] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:55 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:56.645816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:56.646352 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:56.653166 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:56.653661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:56.654103 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:56.654810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:56.655381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:56.655814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:56.783317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:56.785628 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:56.792161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-fac98f7e-7c10-4c0a-a463-b0f4a8e5497c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.150309 Aug 29 20:23:56.792728 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 468/954] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:56 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:57.813702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:57.814309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:57.821538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:57.822026 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:57.822462 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:57.823192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:57.823652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:57.824082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:58.147801 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:58.155612 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dbb10066-37ff-4932-9e4e-e2d2a9e1641f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.345785 Aug 29 20:23:58.156179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 487/955] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:57 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:23:59.178853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:23:59.179535 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:23:59.188266 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:59.188744 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:59.189258 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:59.189972 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:23:59.190433 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:23:59.191281 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:23:59.317927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:23:59.326566 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9e851b54-403c-426c-9634-0abd80659883 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1684 microversion: 2.1 time: 0.152153 Aug 29 20:23:59.327159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 469/956] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:23:59 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:00.348351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:00.348924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:00.351883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:24:00.352018 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Mon Aug 29 20:24:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d (ip 10.222.0.121) !!! Aug 29 20:24:00.359054 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.359568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.360011 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.360713 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.361260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.361686 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.365163 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.503830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:00.512118 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5b5fceb-5aea-4d3e-9fc9-28fb17c647a2 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1661 microversion: 2.1 time: 0.167736 Aug 29 20:24:00.512769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 488/957] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:00 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1661 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:00.533689 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-6a344e81-d550-4bc0-88d5-62f224768aeb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:00.542089 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a344e81-d550-4bc0-88d5-62f224768aeb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.542581 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a344e81-d550-4bc0-88d5-62f224768aeb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.543017 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-6a344e81-d550-4bc0-88d5-62f224768aeb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.564805 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-6a344e81-d550-4bc0-88d5-62f224768aeb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Going to try to start instance {{(pid=120721) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:24:00.605751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-6a344e81-d550-4bc0-88d5-62f224768aeb tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action" status: 202 len: 0 microversion: 2.1 time: 0.075801 Aug 29 20:24:00.606372 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 470/958] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:24:00 2022] POST /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:24:00.619853 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:00.620540 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:00.626778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.627297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.627729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.628525 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:00.628909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:00.629329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:00.763555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:00.771268 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0df1f09-98b8-4a9e-bcca-520f96a5cc95 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1670 microversion: 2.1 time: 0.155262 Aug 29 20:24:00.771831 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 489/959] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:00 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:01.794894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:01.795632 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:01.801678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:01.802156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:01.802586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:01.803300 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:01.803758 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:01.804180 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:01.935471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:01.943242 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-12dff0bf-4de2-4f97-9d33-bba28b0650ed tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1670 microversion: 2.1 time: 0.152982 Aug 29 20:24:01.943819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 471/960] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:01 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:02.972944 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:02.973480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:02.979961 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:02.980450 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:02.980887 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:02.981582 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:02.982049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:02.982479 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:03.113069 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:03.121384 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4699154d-6a99-44e8-be18-3923fce687c0 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1674 microversion: 2.1 time: 0.152734 Aug 29 20:24:03.121949 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 490/961] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:02 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:27.868850 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f5464e62-834e-4090-809d-2e75bb5aef89 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Action: 'create', calling method: .version_select at 0x7f446937a9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-836855821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm3SstmSwpsJrHAvkdPdugIJRVNFJae8MV1wF1R6tT9Qm8vLOZT968m0LwysIamBkgktW8dLD/nBW2CeBHpX1WwcqlypcfG9eFwzsoqYhBULAiV4voSgbzopKkrFyDt5w=="}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:27.874530 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:27.875215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:27.892072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-f5464e62-834e-4090-809d-2e75bb5aef89 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Getting quotas for project 412bd7ce029e414c9a9fa4726d4728cd. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:24:27.895933 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-f5464e62-834e-4090-809d-2e75bb5aef89 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Getting quotas for user ae8cfa393c5f482b84105cf0c934b1d1 and project 412bd7ce029e414c9a9fa4726d4728cd. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:24:27.917795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f5464e62-834e-4090-809d-2e75bb5aef89 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052928 Aug 29 20:24:27.918397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 472/962] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:24:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:27.968463 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1437375152", "imageRef": "85a11653-dd81-4df0-8ae8-81149c9ebffb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-836855821", "networks": [{"uuid": "1f54ebf5-6ecf-4c81-8a9c-bf49e45a7320"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:27.977006 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=41 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:27.977684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=17 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:28.022670 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] validate_networks() for [('1f54ebf5-6ecf-4c81-8a9c-bf49e45a7320', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:24:28.485435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:24:28.485861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:24:28.486380 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:24:28.486807 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:24:28.487289 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:24:28.496894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:28.497379 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:28.497816 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:28.498539 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:28.498996 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:28.499449 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:28.516618 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Getting quotas for project 412bd7ce029e414c9a9fa4726d4728cd. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:24:28.520727 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Getting quotas for user ae8cfa393c5f482b84105cf0c934b1d1 and project 412bd7ce029e414c9a9fa4726d4728cd. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:24:28.532231 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:24:28.534467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85a11653-dd81-4df0-8ae8-81149c9ebffb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:24:28.581615 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63323985-23f7-4690-8528-db7533a108ae tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.617220 Aug 29 20:24:28.582262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 491/963] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:24:27 2022] POST /compute/v2.1/servers => generated 382 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:24:28.593450 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7f345097-66da-4576-bba6-11faf171ba4d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:28.594059 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7f345097-66da-4576-bba6-11faf171ba4d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:28.650260 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7f345097-66da-4576-bba6-11faf171ba4d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:28.658007 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7f345097-66da-4576-bba6-11faf171ba4d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1262 microversion: 2.1 time: 0.068439 Aug 29 20:24:28.658569 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 473/964] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:28 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:29.678652 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:29.679325 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:29.686702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:29.687261 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:29.688024 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:29.689256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:29.690062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:29.690812 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:29.763823 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:29.773428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0eaa157e-abab-4f8b-b13d-0aed6f940f3c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1314 microversion: 2.1 time: 0.098601 Aug 29 20:24:29.791189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 492/965] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:29 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1314 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:29.878172 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:29.878851 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:29.887540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:29.888114 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:29.888999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:29.889428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:29.889884 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:29.891185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:29.916084 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lazy-loading 'flavor' on Instance uuid 0cec8d92-b96e-4c8a-a010-384124fb6248 {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:24:30.005029 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d00ca7c2-18fb-485e-9f94-762f9444c35a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "POST /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248/action" status: 202 len: 0 microversion: 2.1 time: 0.131193 Aug 29 20:24:30.007121 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 474/966] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:24:29 2022] POST /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:24:30.023740 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:30.026259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:30.033309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:30.033909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:30.034536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:30.035419 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:30.035856 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:30.036453 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:30.182731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:30.190710 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23d43a30-5912-401a-9dc7-493ebe87a1d2 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.179499 Aug 29 20:24:30.191346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 493/967] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:30 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:30.800387 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:30.801305 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:30.811615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:30.812116 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:30.812551 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:30.813283 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:30.813762 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:30.814208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:30.977486 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:30.989235 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-15d8d170-2dea-41ca-b7bc-c6e084f60feb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.193074 Aug 29 20:24:30.989819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 475/968] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:30 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:31.212518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:31.213116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:31.220049 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:31.220673 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:31.221273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:31.221820 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:31.222285 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:31.222709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:31.375752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:31.384256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-357ef4c6-5571-4f9b-88ed-0dd60308eb5c tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.175623 Aug 29 20:24:31.384988 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 494/969] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:31 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:32.011175 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:32.012185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:32.019180 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:32.019674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:32.020105 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:32.020893 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:32.021356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:32.021778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:32.160932 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:32.169840 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-50aabfe3-164c-4939-98a5-9da5edeac464 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.162862 Aug 29 20:24:32.170422 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 476/970] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:32 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:32.409372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:32.410175 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:32.416409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:32.416940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:32.417382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:32.418090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:32.418555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:32.418982 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:32.571987 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:32.580333 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9a5d451c-fa2a-457f-92e1-a9e470dafa3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.177079 Aug 29 20:24:32.580904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 495/971] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:32 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:33.191975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:33.192702 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:33.200425 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:33.200904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:33.201333 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:33.202023 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:33.202473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:33.202895 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:33.347575 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:33.356127 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-376d0f4b-84b6-4124-bb80-bd18573aeb50 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.169002 Aug 29 20:24:33.356699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 477/972] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:33 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:33.602472 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:33.604105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:33.611562 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:33.612064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:33.612504 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:33.613226 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:33.613687 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:33.614117 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:33.781761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:33.794972 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa52fa5e-bb09-40a5-88a0-7f2c81488122 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.196293 Aug 29 20:24:33.796155 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 496/973] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:33 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:34.378232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:34.379374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:34.386515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:34.387321 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:34.387998 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:34.388896 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:34.389880 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:34.390500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:34.537333 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:34.550137 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-41ee1b9c-7aeb-4e43-b2a7-21c13d2f8be9 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.175529 Aug 29 20:24:34.551194 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 478/974] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:34 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:34.817932 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:34.818602 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:34.826403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:34.826901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:34.827387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:34.828091 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:34.828548 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:34.828970 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:34.973294 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:34.981406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3e01a6c-0248-43e9-83b7-e088403e270a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.167394 Aug 29 20:24:34.982234 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 497/975] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:34 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:35.571757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:35.572433 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:35.581200 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:35.581795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:35.582300 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:35.583239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:35.583669 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:35.585473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:35.753001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:35.762898 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-88b0cf0b-c5af-406f-b11a-a9309ee83517 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.194596 Aug 29 20:24:35.763882 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 479/976] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:35 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:36.001872 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:36.002511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:36.010634 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:36.011114 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:36.011547 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:36.012248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:36.012703 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:36.013129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:36.155096 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:36.163919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aef753b4-1517-42bb-8984-2d6559f65fcc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.165076 Aug 29 20:24:36.164936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 498/977] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:35 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:36.791668 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:36.792339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:36.798376 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:36.798868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:36.799339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:36.800040 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:36.800497 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:36.800926 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:36.936211 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:36.944436 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-3ad4e51e-d7f7-4802-9169-4733ad8f02ed tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.156941 Aug 29 20:24:36.945014 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 480/978] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:36 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:37.185821 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:37.186571 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:37.193317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:37.193804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:37.194374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:37.195090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:37.195549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:37.195975 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:37.352839 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:37.364567 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-500876e6-aa60-4e6f-8892-5b2903a179ed tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.182598 Aug 29 20:24:37.365144 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 499/979] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:37 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:37.967441 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:37.968126 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:37.975376 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:37.975868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:37.976304 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:37.977019 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:37.977477 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:37.977903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:38.112914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:38.122232 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-89dba4e1-28c6-40b1-858b-200b66811d24 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.159512 Aug 29 20:24:38.123150 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 481/980] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:37 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:38.387875 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:38.388682 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:38.395392 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:38.396233 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:38.396909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:38.398048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:38.398731 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:38.399403 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:38.506644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:38.528181 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:38.557192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:38.565244 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7516a298-e5af-4001-9079-8041d3061d83 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.181558 Aug 29 20:24:38.565819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 500/981] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:38 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:39.143880 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:39.144425 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:39.146202 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:39.152829 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:39.153317 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:39.153753 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:39.154446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:39.154903 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:39.155354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:39.284799 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:39.292408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c9a81ce6-8cb4-4299-a842-827262f9f9f8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.152726 Aug 29 20:24:39.292978 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 482/982] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:39 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:39.587232 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:39.587971 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:39.594525 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:39.595017 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:39.595491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:39.596191 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:39.596654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:39.597086 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:39.732668 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:39.740530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-434b5c48-1950-4f09-af51-0ba43d9929f1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.157246 Aug 29 20:24:39.741609 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 501/983] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:39 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:40.192690 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-e452dd29-37ea-4754-885d-cd6066e49a46 req-67deb8bd-d759-438d-bbaf-eaca8f36855f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cde5aed-13d5-4add-aa8c-5cab126655ff", "tag": "fc3f766a-0e07-4ece-96a4-a1240a4d2219"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:40.202714 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e452dd29-37ea-4754-885d-cd6066e49a46 req-67deb8bd-d759-438d-bbaf-eaca8f36855f service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:40.203240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e452dd29-37ea-4754-885d-cd6066e49a46 req-67deb8bd-d759-438d-bbaf-eaca8f36855f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:40.203653 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-e452dd29-37ea-4754-885d-cd6066e49a46 req-67deb8bd-d759-438d-bbaf-eaca8f36855f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:40.215101 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-e452dd29-37ea-4754-885d-cd6066e49a46 req-67deb8bd-d759-438d-bbaf-eaca8f36855f service nova] Creating event network-changed:fc3f766a-0e07-4ece-96a4-a1240a4d2219 for instance 8cde5aed-13d5-4add-aa8c-5cab126655ff on hv-cinder-85426 Aug 29 20:24:40.220039 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-e452dd29-37ea-4754-885d-cd6066e49a46 req-67deb8bd-d759-438d-bbaf-eaca8f36855f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160977 Aug 29 20:24:40.220675 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 483/984] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:24:40.312698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:40.313309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:40.320170 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:40.320690 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:40.321124 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:40.321822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:40.322280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:40.322711 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:40.453451 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:40.461851 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af36d6e0-a2dc-4e99-b17e-fddfe768325d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.152991 Aug 29 20:24:40.462424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 502/985] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:40 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:40.762794 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:40.763536 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:40.770792 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:40.771311 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:40.771746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:40.772451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:40.772907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:40.773331 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:40.941148 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:40.950634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d9b819c9-050f-4dd7-80f5-f0f24b044c20 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.192060 Aug 29 20:24:40.951701 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 484/986] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:40 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:41.482337 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:41.482924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:41.489537 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.490020 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.490447 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.491774 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.492226 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.492648 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.624012 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:41.631713 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0d66a5c-314b-4155-b410-4d51b8218c59 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.153146 Aug 29 20:24:41.632553 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 503/987] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:41 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:41.692568 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:41.694776 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:41.701156 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.701639 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.702076 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.702764 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.703257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.703683 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.733138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2f19322f-5d47-43b4-a752-b94ab7e53a5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044333 Aug 29 20:24:41.733609 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 485/988] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:24:41 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:24:41.795906 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:41.796417 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:41.802319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.802799 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.803273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.804010 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.804461 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.804882 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.846808 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:24:41.971829 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8178e65c-2485-42c2-a14b-221719d6a6c4 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 204 len: 0 microversion: 2.1 time: 0.178869 Aug 29 20:24:41.972999 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 504/989] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:24:41 2022] DELETE /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:24:41.979276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:41.980010 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:41.982433 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:41.983340 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:41.991737 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.992270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.992687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.993954 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.994420 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.994631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.994851 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.995123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.996036 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:41.996259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:41.996710 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:41.997132 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:42.141297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:42.150625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de9cf35b-c4ec-46c9-8659-cb04e4c045c7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1680 microversion: 2.1 time: 0.172940 Aug 29 20:24:42.151222 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 505/990] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:41 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:42.289170 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:42.296854 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8cc52915-8a4a-47d7-a890-2832f0d56639 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.327696 Aug 29 20:24:42.297411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 486/991] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:41 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:42.652939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:42.653561 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:42.660038 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:42.660524 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:42.660960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:42.661653 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:42.662115 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:42.662538 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:42.680925 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:42.791180 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:42.798776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25b77710-7cac-4933-b0a9-b49c2582884a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.149752 Aug 29 20:24:42.799376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 506/992] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:42 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:43.171937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:43.172552 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:43.179675 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.180163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.180602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:43.181297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.181759 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.182197 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:43.306964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:43.315109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c2dec2a7-8b9e-4e9d-9110-8d17538ed109 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1680 microversion: 2.1 time: 0.146927 Aug 29 20:24:43.315685 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 487/993] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:43 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:43.317791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:43.318394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:43.324917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.325397 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.325833 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:43.326518 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.326978 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.327426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:43.459318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:43.467061 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14b90256-0c90-4d51-9bb4-6507af7bc024 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.153262 Aug 29 20:24:43.467649 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 507/994] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:43 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:43.819120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:43.820041 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:43.825890 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.826383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.826828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:43.827545 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:43.828002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:43.828423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:43.967017 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:43.974845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-014d09ea-6995-4777-be3d-e42aaa9eec73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.159661 Aug 29 20:24:43.975967 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 488/995] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:43 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:44.337333 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:44.337876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:44.344221 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:44.344725 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:44.345139 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:44.345826 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:44.346278 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:44.346698 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:44.476631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:44.484331 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d7431f92-9359-47b1-9624-257e35ae5d3f tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1680 microversion: 2.1 time: 0.151565 Aug 29 20:24:44.484895 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 508/996] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:44 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:44.487779 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:44.488410 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:44.494804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:44.495323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:44.495761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:44.496458 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:44.496916 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:44.497342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:44.501456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:44.626181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:44.634690 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8593009b-796e-4674-a620-b172d077ddbc tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.150839 Aug 29 20:24:44.635276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 489/997] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:44 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:44.997208 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:44.997819 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:45.004010 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:45.004494 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:45.004925 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:45.005616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:45.006074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:45.006501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:45.145385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:45.153835 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec235556-3e16-47a7-8e06-745ce394d82d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.160540 Aug 29 20:24:45.154406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 509/998] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:44 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:45.505528 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:45.507816 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:45.515155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:45.515977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:45.516477 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:45.517173 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:45.517834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:45.518268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:45.658997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:45.660658 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:45.674210 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:45.675273 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:45.675845 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:45.676762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:45.678901 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:45.684913 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:45.685174 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ff8edc6e-3883-41bd-b6d3-434465aa7d1a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1680 microversion: 2.1 time: 0.183554 Aug 29 20:24:45.687590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 490/999] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:45 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:45.688152 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:45.875089 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:45.893105 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9cf9966-de63-496a-a140-a27a8ef42fcd tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.240867 Aug 29 20:24:45.894326 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 510/1000] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:45 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:45.980562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-c397d93a-edf3-42fb-ac55-117b0d68d8ad req-6a785888-bb3f-4d01-b30d-0467f342f10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cde5aed-13d5-4add-aa8c-5cab126655ff", "name": "network-vif-plugged", "status": "completed", "tag": "fc3f766a-0e07-4ece-96a4-a1240a4d2219"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:45.996009 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-c397d93a-edf3-42fb-ac55-117b0d68d8ad req-6a785888-bb3f-4d01-b30d-0467f342f10c service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:45.996647 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-c397d93a-edf3-42fb-ac55-117b0d68d8ad req-6a785888-bb3f-4d01-b30d-0467f342f10c service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:45.997344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-c397d93a-edf3-42fb-ac55-117b0d68d8ad req-6a785888-bb3f-4d01-b30d-0467f342f10c service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:46.011936 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-c397d93a-edf3-42fb-ac55-117b0d68d8ad req-6a785888-bb3f-4d01-b30d-0467f342f10c service nova] Creating event network-vif-plugged:fc3f766a-0e07-4ece-96a4-a1240a4d2219 for instance 8cde5aed-13d5-4add-aa8c-5cab126655ff on hv-cinder-85426 Aug 29 20:24:46.018138 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-c397d93a-edf3-42fb-ac55-117b0d68d8ad req-6a785888-bb3f-4d01-b30d-0467f342f10c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144670 Aug 29 20:24:46.020260 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 491/1001] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:46.176382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:46.177104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:46.185219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:46.185967 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:46.186398 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:46.187157 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:46.187926 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:46.188351 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:46.340042 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:46.347960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38ecd6bb-3ca3-4321-8995-14b98fe4a4e8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.175554 Aug 29 20:24:46.348542 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 511/1002] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:46 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:46.709584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:46.710292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:46.716451 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:46.716980 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:46.717421 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:46.718120 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:46.718586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:46.719016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:46.789734 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:46.798576 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f8d103fd-8721-4792-878f-28044fcf0a40 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1612 microversion: 2.1 time: 0.094077 Aug 29 20:24:46.811700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 492/1003] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:46 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:46.838288 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-979ca079-9d2b-44d1-95d6-5e2a940762ed req-4ee80943-bea6-4656-b2bb-313e77395819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1b5faf-7e07-4876-9370-ad143689d94d", "name": "network-vif-deleted", "tag": "4be43781-5af8-4299-ba83-6e12008e0fb7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:46.854116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-979ca079-9d2b-44d1-95d6-5e2a940762ed req-4ee80943-bea6-4656-b2bb-313e77395819 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:46.854611 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-979ca079-9d2b-44d1-95d6-5e2a940762ed req-4ee80943-bea6-4656-b2bb-313e77395819 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:46.855048 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-979ca079-9d2b-44d1-95d6-5e2a940762ed req-4ee80943-bea6-4656-b2bb-313e77395819 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:46.869390 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-979ca079-9d2b-44d1-95d6-5e2a940762ed req-4ee80943-bea6-4656-b2bb-313e77395819 service nova] Creating event network-vif-deleted:4be43781-5af8-4299-ba83-6e12008e0fb7 for instance 3e1b5faf-7e07-4876-9370-ad143689d94d on hv-cinder-85426 Aug 29 20:24:46.876114 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-979ca079-9d2b-44d1-95d6-5e2a940762ed req-4ee80943-bea6-4656-b2bb-313e77395819 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042154 Aug 29 20:24:46.882329 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 512/1004] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:46.915935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:46.916636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:46.925328 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:46.925828 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:46.926271 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:46.926992 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:46.927705 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:46.929046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.079606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:47.088101 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0babdd1c-5133-49c0-8a7e-862908a5bcaa tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1510 microversion: 2.1 time: 0.177169 Aug 29 20:24:47.088660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 493/1005] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:46 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:47.109409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:47.110202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:47.116607 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.117174 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.117672 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.118436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.118959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.119491 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.150173 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120720) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:24:47.219858 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-340d25fc-53c0-4458-a5e8-6c7f55a19dd9 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "POST /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248/action" status: 202 len: 0 microversion: 2.1 time: 0.114827 Aug 29 20:24:47.220878 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 513/1006] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:24:47 2022] POST /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:24:47.236562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:47.237199 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:47.248280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.248782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.249221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.249945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.250384 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.250928 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.369192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:47.370213 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:47.383446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.383946 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.384382 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.385090 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.385544 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.386168 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.450706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:47.458572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e06eb5e0-84cb-4091-831b-07cd1b4fc695 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1518 microversion: 2.1 time: 0.232969 Aug 29 20:24:47.459161 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 494/1007] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:47 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:47.582432 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:47.592163 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c3d21d6-3b23-49de-b038-35e19e7278a4 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1362 microversion: 2.1 time: 0.227572 Aug 29 20:24:47.592840 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 514/1008] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:47 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:47.823754 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:47.824454 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:47.831152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.831881 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.832423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.833292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.833853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.834350 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.867438 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:47.867919 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:47.868351 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:47.868797 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lazy-loading 'fault' on Instance uuid 3e1b5faf-7e07-4876-9370-ad143689d94d {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:24:47.910626 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:47.918915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-761adc9b-80d8-4b6b-b3fc-413b8efa53ff tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 200 len: 1332 microversion: 2.1 time: 0.100838 Aug 29 20:24:47.919602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 495/1009] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:47 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:48.481830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:48.482467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:48.489020 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.489501 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.489933 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.490635 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.491123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.491551 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.612814 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:48.613448 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:48.620885 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.621381 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.621913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.622717 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.623220 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.623662 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.630940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:48.640260 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3894f544-f954-4bf1-9cb0-129c14342d92 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1520 microversion: 2.1 time: 0.162228 Aug 29 20:24:48.640769 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 515/1010] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:48 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:48.767756 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:48.775804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-aa366e75-c7b2-4a41-a39f-a48f1b593b21 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1552 microversion: 2.1 time: 0.166998 Aug 29 20:24:48.776374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 496/1011] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:48 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:48.795927 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:48.796564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:48.804196 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.804687 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.805318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.806216 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.806674 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.807116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.939460 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:48.940026 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:48.940615 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:48.947309 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.947800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.948103 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bdfc086-e2d8-4d32-aecb-22af374c93f1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1552 microversion: 2.1 time: 0.155938 Aug 29 20:24:48.948226 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.948669 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 516/1012] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:48 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:48.948915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.949368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.949788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.964699 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] HTTP exception thrown: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Request method failure captured: Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d HTTP/1.1 Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR-2BPgxh3azAsbQQOS7fkqe8_bQXnXgstedZpO4ZDCD7HEQoObsXjQwfnkimRdIxaPFMn-uDKqZJ9Ncgi7gGqbw2B8FwAqWySOcxwYmeWQo5-mMxAFP33UnAG8AcbnXlLcoBBs_SkA8MttMhtRzoY-tVvpdQI8-cnZs9FwyGuap0io Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:24:48.966356 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_40982cedd7d840248a05e55d65606b7c", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}] Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: fdba9c71297941608b065dbc3b2015ce Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:24:48.968343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '3e1b5faf-7e07-4876-9370-ad143689d94d'} Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:24:48.969193 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:24:48.970589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:24:48.971793 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Returning 404 to user: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:24:48.971793 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4cbff0e2-a694-4b64-80f0-51b563fd17a9 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 404 len: 111 microversion: 2.1 time: 0.031599 Aug 29 20:24:48.971793 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 497/1013] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:48 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:24:48.972001 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:48.975854 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:48.976619 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Searching by: {'deleted': False, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 20:24:48.977919 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-06dc6131-5f3a-4c12-b46c-b79c74c47ff8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '.version_select at 0x7f4469668040>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:48.983574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.984142 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.984575 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.985354 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:48.985818 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:48.986238 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:48.998931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-06dc6131-5f3a-4c12-b46c-b79c74c47ff8 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179284927" status: 202 len: 0 microversion: 2.1 time: 0.025346 Aug 29 20:24:48.999919 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 498/1014] 10.222.0.121 () {58 vars in 1226 bytes} [Mon Aug 29 20:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179284927 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:24:49.080793 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 20:24:49.183248 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-520779cd-af40-4265-86ac-6bf11eec458f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.218379 Aug 29 20:24:49.187762 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 517/1015] 10.222.0.121 () {58 vars in 1130 bytes} [Mon Aug 29 20:24:48 2022] GET /compute/v2.1/servers => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:24:49.196143 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:49.196853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:49.203598 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:49.204339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:49.204921 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:49.205634 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:49.206092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:49.206517 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:49.339590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:49.347602 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-48b716cb-94bd-4604-ba79-04fea086df14 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1552 microversion: 2.1 time: 0.156288 Aug 29 20:24:49.348247 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 499/1016] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:49 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:49.661318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:49.661919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:49.674744 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:49.675941 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:49.676522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:49.678528 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:49.680273 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:49.682616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:49.830715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-b409ad57-3264-4aa0-860e-d071d0a2be3f req-42af9e10-7f1b-4e08-8c16-8cc7f4514c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cec8d92-b96e-4c8a-a010-384124fb6248", "name": "network-vif-unplugged", "status": "completed", "tag": "1477bb14-bbd7-4b05-8df2-1bdeca091ad8"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:49.842036 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-b409ad57-3264-4aa0-860e-d071d0a2be3f req-42af9e10-7f1b-4e08-8c16-8cc7f4514c00 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:49.842742 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-b409ad57-3264-4aa0-860e-d071d0a2be3f req-42af9e10-7f1b-4e08-8c16-8cc7f4514c00 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:49.843560 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-b409ad57-3264-4aa0-860e-d071d0a2be3f req-42af9e10-7f1b-4e08-8c16-8cc7f4514c00 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:49.856831 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-b409ad57-3264-4aa0-860e-d071d0a2be3f req-42af9e10-7f1b-4e08-8c16-8cc7f4514c00 service nova] Creating event network-vif-unplugged:1477bb14-bbd7-4b05-8df2-1bdeca091ad8 for instance 0cec8d92-b96e-4c8a-a010-384124fb6248 on hv-cinder-85426 Aug 29 20:24:49.862837 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-b409ad57-3264-4aa0-860e-d071d0a2be3f req-42af9e10-7f1b-4e08-8c16-8cc7f4514c00 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036217 Aug 29 20:24:49.864222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 500/1017] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:24:49.876220 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:49.889829 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40824654-61a0-4238-ae73-87de9d4ee881 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.232171 Aug 29 20:24:49.901475 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 518/1018] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:49 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:49.907067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-81e616cd-71da-4713-a84b-636abf0273ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'create', calling method: .version_select at 0x7f4469404670>, body: {"keypair": {"name": "tempest-keypair-845616545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5J7M9AGNh9Z0uWyXDFnfzxpvSaAy8xfsgRoJydlLfUT831yq95PKooBxiTquXDVChi+jrjTcXb8ahrbLM4yAelK5bJ4d5u/PgGnL9bZnTU6mhE2Iu6H4ITYtTgs4MKGw=="}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:49.923115 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-81e616cd-71da-4713-a84b-636abf0273ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for project 40982cedd7d840248a05e55d65606b7c. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:24:49.927637 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-81e616cd-71da-4713-a84b-636abf0273ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for user fdba9c71297941608b065dbc3b2015ce and project 40982cedd7d840248a05e55d65606b7c. Resources: {'key_pairs'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:24:49.950608 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-81e616cd-71da-4713-a84b-636abf0273ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047764 Aug 29 20:24:49.952855 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 501/1019] 10.222.0.121 () {60 vars in 1164 bytes} [Mon Aug 29 20:24:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:24:50.911414 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:50.912367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:50.919550 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:50.920100 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:50.920610 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:50.921580 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:50.922278 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:50.922766 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:50.973700 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5fbf65e-d602-48a6-a170-a93bfc3c3a09"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:50.978472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:50.983914 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:50.984343 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:50.984775 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:50.985557 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:50.986020 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:50.986434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:51.134496 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:51.143391 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c05a31b-c5c7-47f0-868a-f98b33e0e9d1 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.235929 Aug 29 20:24:51.144428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 519/1020] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:50 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:51.249918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-41974e48-63b9-4ae3-965b-b64ef90b8cbd tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280581 Aug 29 20:24:51.250428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 502/1021] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:24:50 2022] POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:24:51.528111 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1713055124", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4efebb65-54be-4a0b-8bb3-3efe85fc7e8a"}], "security_groups": [{"name": "tempest-securitygroup--187998347"}], "key_name": "tempest-keypair-845616545", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:51.636376 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] validate_networks() for [('4efebb65-54be-4a0b-8bb3-3efe85fc7e8a', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:24:52.000297 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:24:52.000980 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:24:52.001372 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:24:52.001790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:24:52.002203 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:24:52.011625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:52.012108 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:52.012566 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:52.013284 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:52.013733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:52.014152 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:52.031178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for project 40982cedd7d840248a05e55d65606b7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:24:52.035095 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Getting quotas for user fdba9c71297941608b065dbc3b2015ce and project 40982cedd7d840248a05e55d65606b7c. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:24:52.045947 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:24:52.048249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:24:52.059332 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:52.097099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ed95a95-cfb7-4ac1-9f8c-e82ff5cfb187 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.573130 Aug 29 20:24:52.097703 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 520/1022] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:24:51 2022] POST /compute/v2.1/servers => generated 403 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:24:52.109231 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-94e1f8bc-aa48-4a60-b7f7-e0154b45ee28 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:52.110074 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-94e1f8bc-aa48-4a60-b7f7-e0154b45ee28 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:52.166502 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-94e1f8bc-aa48-4a60-b7f7-e0154b45ee28 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:52.168563 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:52.169184 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:52.175434 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-94e1f8bc-aa48-4a60-b7f7-e0154b45ee28 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1241 microversion: 2.1 time: 0.070373 Aug 29 20:24:52.176574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 503/1023] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:52 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:52.177702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:52.179114 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:52.179563 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:52.180279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:52.180765 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:52.181198 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:52.319855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:52.328773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e48c6d62-84ae-419f-a4e1-0010204cec3a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.166501 Aug 29 20:24:52.329585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 521/1024] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:52 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:53.196549 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:53.197143 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:53.205979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:53.206481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:53.206917 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:53.207664 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:53.208124 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:53.208596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:53.280755 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:53.289925 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-e6b49eda-28a4-4a31-a5ec-f77a6412f63c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1311 microversion: 2.1 time: 0.097307 Aug 29 20:24:53.290596 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 504/1025] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:53 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:53.349660 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:53.351025 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:53.357462 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:53.357943 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:53.358385 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:53.359156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:53.359557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:53.359981 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:53.498104 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:53.505784 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22d80f05-ba19-4c28-8950-8eac498e5bb3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.159983 Aug 29 20:24:53.507131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 522/1026] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:53 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:54.312240 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:54.312845 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:54.319413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:54.319976 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:54.320415 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:54.321075 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:54.321614 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:54.322058 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:54.460513 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:54.468722 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9b636737-4446-418f-8fe1-f35cd031670c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1366 microversion: 2.1 time: 0.161001 Aug 29 20:24:54.469829 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 505/1027] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:54 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:54.528109 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:54.528758 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:54.535417 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:54.535905 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:54.536343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:54.537044 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:54.538096 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:54.538531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:54.542899 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:54.570185 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-0cf04205-53bf-46fb-a787-2bdf78774ed3 req-42e3dec1-5e56-4313-bd33-e116e8d708a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c27fc90-0bc4-4216-bf1f-a96618e0a19b", "tag": "b3d6d39d-d852-4cf3-93c2-69a0014960ab"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:24:54.580431 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-0cf04205-53bf-46fb-a787-2bdf78774ed3 req-42e3dec1-5e56-4313-bd33-e116e8d708a8 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:54.581087 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-0cf04205-53bf-46fb-a787-2bdf78774ed3 req-42e3dec1-5e56-4313-bd33-e116e8d708a8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:54.581853 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-0cf04205-53bf-46fb-a787-2bdf78774ed3 req-42e3dec1-5e56-4313-bd33-e116e8d708a8 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:54.605316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-0cf04205-53bf-46fb-a787-2bdf78774ed3 req-42e3dec1-5e56-4313-bd33-e116e8d708a8 service nova] Creating event network-changed:b3d6d39d-d852-4cf3-93c2-69a0014960ab for instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b on hv-cinder-85426 Aug 29 20:24:54.610974 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-0cf04205-53bf-46fb-a787-2bdf78774ed3 req-42e3dec1-5e56-4313-bd33-e116e8d708a8 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046807 Aug 29 20:24:54.612101 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 506/1028] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:24:54.681317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:54.689557 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f1f5107-1e0a-4589-9253-3ed10f3be910 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.165342 Aug 29 20:24:54.690127 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 523/1029] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:54 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:55.490368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:55.491066 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:55.494123 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:55.498149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:55.498635 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:55.499071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:55.499789 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:55.500248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:55.500674 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:55.636489 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:55.644205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-70dd84c9-859e-4cb1-8736-e4c14e2d6f92 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1366 microversion: 2.1 time: 0.158482 Aug 29 20:24:55.644765 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 507/1030] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:55 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:55.710568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:55.711245 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:55.717849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:55.718340 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:55.718778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:55.719522 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:55.719982 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:55.720405 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:55.854346 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:55.862137 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-831d1097-053f-4b36-9b63-8101cb46e01a tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.156105 Aug 29 20:24:55.862714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 524/1031] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:55 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:56.666270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:56.667042 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:56.674637 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:56.675370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:56.675912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:56.676713 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:56.677270 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:56.678476 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:56.814810 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:56.822769 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c6d6e0b1-cb2f-4085-9aa6-cee31b53ee5d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1366 microversion: 2.1 time: 0.160975 Aug 29 20:24:56.823687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 508/1032] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:56 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:56.883697 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:56.884301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:56.891998 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:56.892558 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:56.893074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:56.893773 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:56.894222 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:56.894644 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:57.028271 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:57.035924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eed34138-b65e-4919-9db9-8bcc08ff0de8 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.156585 Aug 29 20:24:57.036480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 525/1033] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:56 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:57.844454 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:57.846606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:57.853991 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:57.854492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:57.854941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:57.855679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:57.856132 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:57.856741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:57.991511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:57.995002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:58.000847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-4b6d3603-5ce0-4683-acd2-b49f0ddc389b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1366 microversion: 2.1 time: 0.160317 Aug 29 20:24:58.001426 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 509/1034] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:57 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:58.057753 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:58.058540 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:58.065087 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:58.065587 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:58.066082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:58.066791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:58.067296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:58.067726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:58.202681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:58.210497 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6373af36-88fc-4ee8-9ec1-681224f07b36 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1576 microversion: 2.1 time: 0.156615 Aug 29 20:24:58.211092 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 526/1035] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:58 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:58.879061 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:58.879693 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:58.886834 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:58.887562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:58.888002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:58.888790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:58.889186 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:58.889603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:59.022564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:59.023305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:59.026306 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:59.029525 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:59.030007 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:59.030469 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:59.031197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:59.031650 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:59.032071 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:59.034661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-ef7c09ed-2567-4c39-977e-a1cd52384016 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1598 microversion: 2.1 time: 0.159530 Aug 29 20:24:59.035252 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 510/1036] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:58 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:24:59.194151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:59.201855 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1749d11-a79e-4d0e-9060-4ca021291c5b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1366 microversion: 2.1 time: 0.183877 Aug 29 20:24:59.202648 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 527/1037] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:59 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:24:59.231768 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:59.232379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:24:59.238771 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:59.239351 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:59.239815 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:59.240588 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:59.241051 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:59.241478 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:59.377292 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:24:59.386551 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-820a386e-dded-43ca-94e7-c17a35ee2675 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1563 microversion: 2.1 time: 0.158605 Aug 29 20:24:59.387154 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 511/1038] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:24:59 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:00.098409 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-369dd675-660a-451a-9195-a3c6885bbd53 req-0554876b-cd99-42c7-a746-f6b9ef617a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c27fc90-0bc4-4216-bf1f-a96618e0a19b", "name": "network-vif-plugged", "status": "completed", "tag": "b3d6d39d-d852-4cf3-93c2-69a0014960ab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:00.109364 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-369dd675-660a-451a-9195-a3c6885bbd53 req-0554876b-cd99-42c7-a746-f6b9ef617a03 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:00.110131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-369dd675-660a-451a-9195-a3c6885bbd53 req-0554876b-cd99-42c7-a746-f6b9ef617a03 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:00.110595 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-369dd675-660a-451a-9195-a3c6885bbd53 req-0554876b-cd99-42c7-a746-f6b9ef617a03 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:00.123169 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-369dd675-660a-451a-9195-a3c6885bbd53 req-0554876b-cd99-42c7-a746-f6b9ef617a03 service nova] Creating event network-vif-plugged:b3d6d39d-d852-4cf3-93c2-69a0014960ab for instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b on hv-cinder-85426 Aug 29 20:25:00.128438 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-369dd675-660a-451a-9195-a3c6885bbd53 req-0554876b-cd99-42c7-a746-f6b9ef617a03 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 Aug 29 20:25:00.129364 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 528/1039] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:00.223456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:00.225126 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:00.231868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:00.238095 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:00.238712 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:00.252107 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:00.252612 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:00.253059 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:00.411428 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:00.420993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7627ac27-832f-41ac-b537-515547471a80 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1366 microversion: 2.1 time: 0.201272 Aug 29 20:25:00.421670 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 512/1040] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:00 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:00.784508 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-bbd97881-c293-49e7-b2e0-d5070f4de9e3 req-ba4d0412-cf7a-4e2c-ab36-e2ea6418f0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cde5aed-13d5-4add-aa8c-5cab126655ff", "tag": "fc3f766a-0e07-4ece-96a4-a1240a4d2219"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:00.794245 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bbd97881-c293-49e7-b2e0-d5070f4de9e3 req-ba4d0412-cf7a-4e2c-ab36-e2ea6418f0df service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:00.794998 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bbd97881-c293-49e7-b2e0-d5070f4de9e3 req-ba4d0412-cf7a-4e2c-ab36-e2ea6418f0df service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:00.795671 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bbd97881-c293-49e7-b2e0-d5070f4de9e3 req-ba4d0412-cf7a-4e2c-ab36-e2ea6418f0df service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:00.807910 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-bbd97881-c293-49e7-b2e0-d5070f4de9e3 req-ba4d0412-cf7a-4e2c-ab36-e2ea6418f0df service nova] Creating event network-changed:fc3f766a-0e07-4ece-96a4-a1240a4d2219 for instance 8cde5aed-13d5-4add-aa8c-5cab126655ff on hv-cinder-85426 Aug 29 20:25:00.813774 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-bbd97881-c293-49e7-b2e0-d5070f4de9e3 req-ba4d0412-cf7a-4e2c-ab36-e2ea6418f0df service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Aug 29 20:25:00.814521 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 529/1041] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:01.444556 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:01.446707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:01.455177 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:01.455773 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:01.456285 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:01.457069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:01.457605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:01.458110 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:01.620393 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:01.631856 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-43b84ace-945c-47dd-9aee-9553859ace94 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1366 microversion: 2.1 time: 0.194498 Aug 29 20:25:01.632941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 513/1042] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:01 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:01.932516 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-97068175"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:01.933064 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:01.940127 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:01.940467 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:01.940894 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:01.941592 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:01.942040 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:01.942456 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.024193 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:02.041704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:02.074985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Adding security group b5e417cb-a147-4c6c-b147-10fa890cb4de to port fc3f766a-0e07-4ece-96a4-a1240a4d2219 Aug 29 20:25:02.148339 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-4f24ffa7-b9d6-4724-9ac6-09573cfd91d6 req-ca42a9b3-83e8-485b-8275-d864aa9cb063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cec8d92-b96e-4c8a-a010-384124fb6248", "name": "network-vif-plugged", "status": "completed", "tag": "1477bb14-bbd7-4b05-8df2-1bdeca091ad8"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:02.158865 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4f24ffa7-b9d6-4724-9ac6-09573cfd91d6 req-ca42a9b3-83e8-485b-8275-d864aa9cb063 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.159875 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4f24ffa7-b9d6-4724-9ac6-09573cfd91d6 req-ca42a9b3-83e8-485b-8275-d864aa9cb063 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.160135 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-4f24ffa7-b9d6-4724-9ac6-09573cfd91d6 req-ca42a9b3-83e8-485b-8275-d864aa9cb063 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.173562 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-4f24ffa7-b9d6-4724-9ac6-09573cfd91d6 req-ca42a9b3-83e8-485b-8275-d864aa9cb063 service nova] Creating event network-vif-plugged:1477bb14-bbd7-4b05-8df2-1bdeca091ad8 for instance 0cec8d92-b96e-4c8a-a010-384124fb6248 on hv-cinder-85426 Aug 29 20:25:02.177257 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=6 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:02.179338 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-4f24ffa7-b9d6-4724-9ac6-09573cfd91d6 req-ca42a9b3-83e8-485b-8275-d864aa9cb063 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035400 Aug 29 20:25:02.180044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 514/1043] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:25:02.440417 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a14ce341-ce48-4cc3-9b7c-a81a3c37bc01 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/action" status: 202 len: 0 microversion: 2.1 time: 0.512120 Aug 29 20:25:02.441151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 530/1044] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:25:01 2022] POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:02.450605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:02.451340 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:02.458625 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.459319 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.459603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.460318 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.460955 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.461758 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.556700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e9808513-ae40-492a-ab63-eed6b219c364 req-d2ed07b7-a0ca-4542-a070-fe6099e20cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cde5aed-13d5-4add-aa8c-5cab126655ff", "tag": "fc3f766a-0e07-4ece-96a4-a1240a4d2219"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:02.566310 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e9808513-ae40-492a-ab63-eed6b219c364 req-d2ed07b7-a0ca-4542-a070-fe6099e20cb5 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.566795 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e9808513-ae40-492a-ab63-eed6b219c364 req-d2ed07b7-a0ca-4542-a070-fe6099e20cb5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.567251 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e9808513-ae40-492a-ab63-eed6b219c364 req-d2ed07b7-a0ca-4542-a070-fe6099e20cb5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.579303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e9808513-ae40-492a-ab63-eed6b219c364 req-d2ed07b7-a0ca-4542-a070-fe6099e20cb5 service nova] Creating event network-changed:fc3f766a-0e07-4ece-96a4-a1240a4d2219 for instance 8cde5aed-13d5-4add-aa8c-5cab126655ff on hv-cinder-85426 Aug 29 20:25:02.584679 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e9808513-ae40-492a-ab63-eed6b219c364 req-d2ed07b7-a0ca-4542-a070-fe6099e20cb5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118002 Aug 29 20:25:02.585746 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 531/1045] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:02.641650 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:02.652207 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-66d6bbc1-2542-4fc7-9f87-2badcab1e3c8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1762 microversion: 2.1 time: 0.205708 Aug 29 20:25:02.653471 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 515/1046] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:02 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1762 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:02.658131 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:02.658924 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:02.666136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.666749 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.667317 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.668283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.668946 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.674381 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.859366 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:02.869470 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20ce03f1-e481-4a9b-8ee6-eff69942d00a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1552 microversion: 2.1 time: 0.219878 Aug 29 20:25:02.870503 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 532/1047] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:02 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:25:02.890405 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:02.891046 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:02.896999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.897480 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.897913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.898806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:02.899293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:02.899718 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:02.997221 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-2c2d4885-20f5-4c1c-a6d2-d4449436782a tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110629 Aug 29 20:25:02.997895 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 516/1048] 10.222.0.121 () {58 vars in 1280 bytes} [Mon Aug 29 20:25:02 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:04.604431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6b463bd5-822e-48c9-a257-702e63d3718f req-314af86a-1043-4b77-a72c-cd6b5354d31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c27fc90-0bc4-4216-bf1f-a96618e0a19b", "tag": "b3d6d39d-d852-4cf3-93c2-69a0014960ab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:04.614437 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b463bd5-822e-48c9-a257-702e63d3718f req-314af86a-1043-4b77-a72c-cd6b5354d31f service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:04.615536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b463bd5-822e-48c9-a257-702e63d3718f req-314af86a-1043-4b77-a72c-cd6b5354d31f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:04.615965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b463bd5-822e-48c9-a257-702e63d3718f req-314af86a-1043-4b77-a72c-cd6b5354d31f service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:04.626771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6b463bd5-822e-48c9-a257-702e63d3718f req-314af86a-1043-4b77-a72c-cd6b5354d31f service nova] Creating event network-changed:b3d6d39d-d852-4cf3-93c2-69a0014960ab for instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b on hv-cinder-85426 Aug 29 20:25:04.631918 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6b463bd5-822e-48c9-a257-702e63d3718f req-314af86a-1043-4b77-a72c-cd6b5354d31f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031220 Aug 29 20:25:04.632593 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 533/1049] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:34.866978 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=18 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:34.867762 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=36 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:34.871800 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:34.874063 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:34.881641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:34.882130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:34.882574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:34.883305 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:34.883770 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:34.884199 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:34.956698 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-683d3800-3807-479b-ae48-1a13ace7cda1 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/action" status: 202 len: 0 microversion: 2.1 time: 0.090895 Aug 29 20:25:34.960870 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 517/1050] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:25:34 2022] POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:25:34.964327 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=26 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:34.965070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=46 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:34.969205 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:34.969940 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:34.977181 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:34.977670 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:34.978101 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:34.978800 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:34.979282 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:34.979711 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:35.131651 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:35.140303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fbe94f6b-4695-4665-8cc1-a39e17ede3fe tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1754 microversion: 2.1 time: 0.177798 Aug 29 20:25:35.140883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 534/1051] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:34 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:36.162563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:36.163289 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:36.169921 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:36.170411 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:36.170858 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:36.171605 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:36.172063 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:36.172492 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:36.318055 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:36.326391 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-893eb9c4-b996-41f8-822d-7943491ee29d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.168599 Aug 29 20:25:36.326950 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 518/1052] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:36 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:37.347625 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:37.348227 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:37.355320 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:37.355798 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:37.356229 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:37.356936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:37.357387 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:37.357804 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:37.501416 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:37.510366 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f9842f1-1a92-469f-8ad4-7293723c2d73 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.166590 Aug 29 20:25:37.510929 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 535/1053] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:37 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:38.532131 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:38.532742 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:38.539661 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:38.540159 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:38.540601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:38.541300 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:38.541761 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:38.542191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:38.688630 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:38.697072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c0d991bd-092f-4e66-a2fb-1ef21d30f67f tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.168944 Aug 29 20:25:38.697646 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 519/1054] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:38 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:39.718463 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:39.719113 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:39.725527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:39.726005 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:39.726436 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:39.727148 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:39.727608 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:39.728028 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:39.872374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:39.880879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91e77096-c70d-4920-867a-aa10cc4bf6eb tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.166359 Aug 29 20:25:39.881453 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 536/1055] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:39 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:40.901643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:40.902248 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:40.909347 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:40.909823 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:40.910249 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:40.910935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:40.911420 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:40.911841 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:41.057757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:41.065974 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8d4d80d5-dc67-4e20-b6cc-6bb26957b8bc tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.168196 Aug 29 20:25:41.066535 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 520/1056] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:40 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:42.088177 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:42.088787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:42.095675 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:42.096161 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:42.096601 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:42.097305 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:42.097771 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:42.098194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:42.236367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:42.245066 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b3da8ef-803c-4ec6-bfd6-ee5bc4bd859e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.161454 Aug 29 20:25:42.245637 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 537/1057] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:42 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:43.266707 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:43.267332 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:43.273980 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:43.274460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:43.274890 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:43.275618 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:43.276070 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:43.276490 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:43.427008 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:43.436001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f6cac4b7-60cc-4383-8dfb-d8643836099c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.173258 Aug 29 20:25:43.436574 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 521/1058] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:43 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:44.459192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:44.460336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:44.466704 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:44.467360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:44.467792 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:44.468480 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:44.468936 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:44.469360 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:44.609678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:44.618363 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fce0c25c-786f-4f28-bdde-9520232b4664 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.163137 Aug 29 20:25:44.618938 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 538/1059] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:44 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:45.640142 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:45.640753 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:45.647516 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:45.648004 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:45.648447 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:45.649147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:45.649592 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:45.650018 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:45.792178 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:45.800807 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9342b817-9e41-4c8f-b65a-c2a10c4d1d86 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.164766 Aug 29 20:25:45.801460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 522/1060] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:45 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:46.822571 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:46.823194 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:46.829684 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:46.830167 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:46.830604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:46.831330 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:46.831791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:46.832223 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:46.979124 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:46.987272 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4430002d-b1b3-42bd-8397-5a029570ff56 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.169325 Aug 29 20:25:46.987844 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 539/1061] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:46 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:47.633420 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:47.634037 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:47.640404 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:47.640887 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:47.641323 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:47.642016 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:47.642475 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:47.642899 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:47.665606 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-02fb0b7b-ec8b-484d-8508-606fa6bc5319 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/ips" status: 200 len: 146 microversion: 2.1 time: 0.036955 Aug 29 20:25:47.666163 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 523/1062] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:25:47 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:48.008592 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:48.009128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:48.015585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:48.016128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:48.016561 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:48.017249 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:48.017709 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:48.018149 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:48.158156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:48.166947 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-488d3e12-3ceb-4a63-a988-1075eff0b372 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.162618 Aug 29 20:25:48.167549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 540/1063] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:48 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:48.997457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4827ec28-af20-4582-aa6c-4106245554a0"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:49.000048 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:49.006811 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:49.007338 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:49.007782 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:49.008481 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:49.008969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:49.009389 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:49.188751 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:49.190052 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:49.197014 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:49.197531 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:49.198003 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:49.198716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:49.199264 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:49.199797 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:49.267781 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9b5d5227-8e7d-42a8-a78d-1f365975ce1c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274032 Aug 29 20:25:49.271205 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 524/1064] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:25:48 2022] POST /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:49.370053 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:49.380279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-134cb7fb-e1bb-4098-acd4-30be6080434d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.195327 Aug 29 20:25:49.381583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 541/1065] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:49 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:25:50.403108 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:50.405002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:50.411839 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:50.412865 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:50.413342 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:50.414072 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:50.414524 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:50.414945 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:50.562639 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:50.571778 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f1871e5e-ef6b-4c84-ab42-197f92b86360 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.173661 Aug 29 20:25:50.572359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 525/1066] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:50 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:51.515590 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:51.517721 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:51.523962 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:51.524445 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:51.524884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:51.525577 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:51.526029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:51.526450 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:51.556446 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9a86f1e-6232-4577-bca4-313193f002ae tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 29 20:25:51.557014 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 542/1067] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:25:51 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:51.567408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:51.567886 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:51.574835 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:51.575385 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:51.575821 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:51.576521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:51.576976 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:51.577397 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:51.593527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:51.594426 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:51.600811 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:51.601296 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:51.601729 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:51.602416 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:51.602871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:51.603322 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:51.609223 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-a2dd8b98-1845-4007-b0f5-28752587d14b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/4827ec28-af20-4582-aa6c-4106245554a0" status: 200 len: 194 microversion: 2.1 time: 0.045705 Aug 29 20:25:51.609832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 526/1068] 10.222.0.121 () {58 vars in 1418 bytes} [Mon Aug 29 20:25:51 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/4827ec28-af20-4582-aa6c-4106245554a0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:51.772716 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:51.781389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-791bdd0f-9b75-41b8-bf3e-cc8181898da8 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1759 microversion: 2.1 time: 0.191598 Aug 29 20:25:51.782147 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 543/1069] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:51 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:25:52.803589 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:52.804130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:52.810422 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.810907 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.811383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.812079 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.812542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.812970 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.954521 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:25:52.963040 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-58c61c48-3e5a-4451-a401-d3c26ed8784a tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1762 microversion: 2.1 time: 0.163940 Aug 29 20:25:52.963703 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 527/1070] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:25:52 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1762 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:52.965532 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d29a9864-0af5-40ce-9278-a1e7bc69d525"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:52.967860 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:25:52.974189 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.974710 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.975171 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:52.975869 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:25:52.976328 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:25:52.976752 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:25:53.215668 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-37d58eca-6b11-41c0-a13d-3bc0eaf2aa7d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "POST /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253880 Aug 29 20:25:53.219167 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 544/1071] 10.222.0.121 () {60 vars in 1328 bytes} [Mon Aug 29 20:25:52 2022] POST /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:26:00.724963 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:00.727268 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:00.734455 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:00.734948 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:00.735586 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:00.736301 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:00.736767 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:00.737197 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:00.768228 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-bded0c0b-24fd-421f-b32f-e7f444a3c1ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047207 Aug 29 20:26:00.768824 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 528/1072] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:26:00 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:00.907909 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:00.908486 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:00.914678 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:00.915201 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:00.915638 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:00.916324 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:00.916776 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:00.917197 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:00.946468 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d2ff39f-47b9-45df-818a-619d4cfd206b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/4827ec28-af20-4582-aa6c-4106245554a0" status: 200 len: 194 microversion: 2.1 time: 0.043457 Aug 29 20:26:00.947165 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 545/1073] 10.222.0.121 () {58 vars in 1418 bytes} [Mon Aug 29 20:26:00 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/4827ec28-af20-4582-aa6c-4106245554a0 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:00.958457 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:00.959593 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:00.966713 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:00.967293 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:00.967734 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:00.968526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:00.969237 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:00.969760 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:01.053507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lazy-loading 'services' on Instance uuid 3c27fc90-0bc4-4216-bf1f-a96618e0a19b {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:26:01.125287 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-5f16387e-8a02-4cda-8d1f-8602d49a90d7 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/4827ec28-af20-4582-aa6c-4106245554a0" status: 202 len: 0 microversion: 2.1 time: 0.171062 Aug 29 20:26:01.125868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 529/1074] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:26:00 2022] DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/4827ec28-af20-4582-aa6c-4106245554a0 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:26:02.243063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:02.243566 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:02.249904 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:02.250509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:02.250944 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:02.251668 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:02.252129 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:02.252554 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:02.282471 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8f58d92-2497-4774-bd87-2738154cb2ce tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/d29a9864-0af5-40ce-9278-a1e7bc69d525" status: 200 len: 194 microversion: 2.1 time: 0.043262 Aug 29 20:26:02.283051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 546/1075] 10.222.0.121 () {58 vars in 1418 bytes} [Mon Aug 29 20:26:02 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/d29a9864-0af5-40ce-9278-a1e7bc69d525 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:02.294313 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:02.294959 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:02.301023 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:02.301507 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:02.301941 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:02.302672 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:02.303153 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:02.303584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:02.379515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:02.384987 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lazy-loading 'services' on Instance uuid 3c27fc90-0bc4-4216-bf1f-a96618e0a19b {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:26:02.457989 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-cc049f51-b334-4b84-8173-0bc22736b285 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/d29a9864-0af5-40ce-9278-a1e7bc69d525" status: 202 len: 0 microversion: 2.1 time: 0.168247 Aug 29 20:26:02.459460 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 530/1076] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:26:02 2022] DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments/d29a9864-0af5-40ce-9278-a1e7bc69d525 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:26:03.627259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:03.629790 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:03.636667 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:03.637151 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:03.637591 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:03.638361 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:03.638730 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:03.639179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:03.667955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5e5955f-8bcc-4202-aa6d-98e977977c6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044662 Aug 29 20:26:03.668498 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 547/1077] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:26:03 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:26:03.782348 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:03.784977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:03.790858 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:03.791379 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:03.791817 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:03.792504 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:03.792977 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:03.793427 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:03.824550 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-db427299-9f32-4a03-ab63-b41b11e09b12 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046927 Aug 29 20:26:03.825130 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 531/1078] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:26:03 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:26:03.888182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:03.888182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:03.894065 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:03.894549 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:03.894985 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:03.895707 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:03.896166 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:03.897375 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:03.922288 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:26:03.936495 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:03.998323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f12f139-5516-4543-b21a-23b653dc7e6d tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 204 len: 0 microversion: 2.1 time: 0.114514 Aug 29 20:26:03.999004 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 548/1079] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:26:03 2022] DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:26:04.008048 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:04.008655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:04.014433 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:04.014937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:04.015408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:04.016109 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:04.016561 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:04.016978 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:04.147935 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:04.155617 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-26556329-3fdf-4e2e-8a91-9f9e82d7a3a1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1677 microversion: 2.1 time: 0.152298 Aug 29 20:26:04.156181 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 532/1080] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:04 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:05.176532 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:05.177233 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:05.179584 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:05.184814 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:05.185298 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:05.185733 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:05.186431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:05.186889 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:05.187569 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:05.320871 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:05.328574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fff3a76d-a862-453b-8185-b8ec54304c66 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1677 microversion: 2.1 time: 0.156366 Aug 29 20:26:05.329152 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 549/1081] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:05 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:06.350413 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:06.351122 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:06.353537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=33 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:06.359059 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:06.359580 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:06.360018 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:06.360724 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:06.361272 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:06.361597 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:06.492470 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:06.500469 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-0b3d707e-8f22-4051-97a3-0f655af6c180 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1677 microversion: 2.1 time: 0.154487 Aug 29 20:26:06.501278 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 533/1082] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:06 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:06.969681 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-704c6028-c2bf-4fb6-a80e-24f36541dbf4 req-4a8b92c4-ad2f-41e1-9763-4b6d1b111d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c27fc90-0bc4-4216-bf1f-a96618e0a19b", "name": "network-vif-deleted", "tag": "b3d6d39d-d852-4cf3-93c2-69a0014960ab"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:06.983693 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-704c6028-c2bf-4fb6-a80e-24f36541dbf4 req-4a8b92c4-ad2f-41e1-9763-4b6d1b111d23 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:06.984633 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-704c6028-c2bf-4fb6-a80e-24f36541dbf4 req-4a8b92c4-ad2f-41e1-9763-4b6d1b111d23 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:06.985062 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-704c6028-c2bf-4fb6-a80e-24f36541dbf4 req-4a8b92c4-ad2f-41e1-9763-4b6d1b111d23 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:06.998224 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-704c6028-c2bf-4fb6-a80e-24f36541dbf4 req-4a8b92c4-ad2f-41e1-9763-4b6d1b111d23 service nova] Creating event network-vif-deleted:b3d6d39d-d852-4cf3-93c2-69a0014960ab for instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b on hv-cinder-85426 Aug 29 20:26:07.003094 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-704c6028-c2bf-4fb6-a80e-24f36541dbf4 req-4a8b92c4-ad2f-41e1-9763-4b6d1b111d23 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037638 Aug 29 20:26:07.004934 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 550/1083] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:07.522152 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:07.523843 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:07.530462 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:07.530956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:07.531443 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:07.532168 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:07.532627 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:07.533071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:07.566432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:07.567208 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:07.567836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:07.568992 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lazy-loading 'fault' on Instance uuid 3c27fc90-0bc4-4216-bf1f-a96618e0a19b {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:26:07.614191 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba9c71297941608b065dbc3b2015ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40982cedd7d840248a05e55d65606b7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:07.621399 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-7a8bb16d-0e05-425b-9d01-c1b94a819e30 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 200 len: 1331 microversion: 2.1 time: 0.103630 Aug 29 20:26:07.622149 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 534/1084] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:07 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:08.643872 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:08.644568 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:08.651772 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:08.652259 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:08.652694 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:08.653394 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:08.653852 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:08.654277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:08.668044 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] HTTP exception thrown: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Request method failure captured: Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b HTTP/1.1 Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR-2BPgxh3azAsbQQOS7fkqe8_bQXnXgstedZpO4ZDCD7HEQoObsXjQwfnkimRdIxaPFMn-uDKqZJ9Ncgi7gGqbw2B8FwAqWySOcxwYmeWQo5-mMxAFP33UnAG8AcbnXlLcoBBs_SkA8MttMhtRzoY-tVvpdQI8-cnZs9FwyGuap0io Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:26:08.669576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_40982cedd7d840248a05e55d65606b7c", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}] Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: fdba9c71297941608b065dbc3b2015ce Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:08.671406 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '3c27fc90-0bc4-4216-bf1f-a96618e0a19b'} Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:08.672359 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:08.673884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:08.675279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Returning 404 to user: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:08.675279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ceea180-7838-4ab5-b8be-e3a36f0753d5 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 404 len: 111 microversion: 2.1 time: 0.031289 Aug 29 20:26:08.675279 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 551/1085] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:08 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:08.679918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-53a6b5e8-06d0-4bcd-bf17-91bf559ebf16 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '.version_select at 0x7f446941d670>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:08.698509 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-53a6b5e8-06d0-4bcd-bf17-91bf559ebf16 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845616545" status: 202 len: 0 microversion: 2.1 time: 0.022573 Aug 29 20:26:08.699067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 535/1086] 10.222.0.121 () {58 vars in 1223 bytes} [Mon Aug 29 20:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845616545 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:26:11.695097 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:11.695616 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:11.701959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:11.702470 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:11.702902 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:11.703621 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:11.704074 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:11.704495 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:11.720555 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] HTTP exception thrown: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Request method failure captured: Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b HTTP/1.1 Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR-2BPgxh3azAsbQQOS7fkqe8_bQXnXgstedZpO4ZDCD7HEQoObsXjQwfnkimRdIxaPFMn-uDKqZJ9Ncgi7gGqbw2B8FwAqWySOcxwYmeWQo5-mMxAFP33UnAG8AcbnXlLcoBBs_SkA8MttMhtRzoY-tVvpdQI8-cnZs9FwyGuap0io Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:26:11.722125 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_40982cedd7d840248a05e55d65606b7c", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}] Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: fdba9c71297941608b065dbc3b2015ce Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.723659 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '3c27fc90-0bc4-4216-bf1f-a96618e0a19b'} Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:11.724435 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.726791 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.728353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Returning 404 to user: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:11.728353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4857caaa-b1ae-4271-9eb4-b1687701aa2b tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 404 len: 111 microversion: 2.1 time: 0.032235 Aug 29 20:26:11.728353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 552/1087] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:26:11 2022] DELETE /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:11.733179 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:11.733826 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3c27fc90-0bc4-4216-bf1f-a96618e0a19b] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:11.740429 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:11.740915 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:11.741354 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:11.742044 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:11.742503 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:11.742928 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:11.756234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] HTTP exception thrown: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Request method failure captured: Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b HTTP/1.1 Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR-2BPgxh3azAsbQQOS7fkqe8_bQXnXgstedZpO4ZDCD7HEQoObsXjQwfnkimRdIxaPFMn-uDKqZJ9Ncgi7gGqbw2B8FwAqWySOcxwYmeWQo5-mMxAFP33UnAG8AcbnXlLcoBBs_SkA8MttMhtRzoY-tVvpdQI8-cnZs9FwyGuap0io Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:26:11.757897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_40982cedd7d840248a05e55d65606b7c", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}] Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: fdba9c71297941608b065dbc3b2015ce Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.759570 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '3c27fc90-0bc4-4216-bf1f-a96618e0a19b'} Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:11.763446 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. Aug 29 20:26:11.764964 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:11.766710 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Returning 404 to user: Instance 3c27fc90-0bc4-4216-bf1f-a96618e0a19b could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:11.766710 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8e3a6a28-1cd7-4405-821c-70711f971d6c tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b" status: 404 len: 111 microversion: 2.1 time: 0.030661 Aug 29 20:26:11.766710 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 536/1088] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:11 2022] GET /compute/v2.1/servers/3c27fc90-0bc4-4216-bf1f-a96618e0a19b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:12.897464 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:12.897986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:12.904431 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:12.904912 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:12.905377 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:12.906072 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:12.906532 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:12.906959 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:12.920121 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] HTTP exception thrown: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Request method failure captured: Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d HTTP/1.1 Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDR-2BPgxh3azAsbQQOS7fkqe8_bQXnXgstedZpO4ZDCD7HEQoObsXjQwfnkimRdIxaPFMn-uDKqZJ9Ncgi7gGqbw2B8FwAqWySOcxwYmeWQo5-mMxAFP33UnAG8AcbnXlLcoBBs_SkA8MttMhtRzoY-tVvpdQI8-cnZs9FwyGuap0io Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:26:12.921661 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_40982cedd7d840248a05e55d65606b7c", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}] Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: fdba9c71297941608b065dbc3b2015ce Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.923304 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': '3e1b5faf-7e07-4876-9370-ad143689d94d'} Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:12.924293 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.925756 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.927280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Returning 404 to user: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:12.927280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44726e77-60b4-4e2e-a0f2-dfe32d8f9d45 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 404 len: 111 microversion: 2.1 time: 0.030064 Aug 29 20:26:12.927280 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 553/1089] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:26:12 2022] DELETE /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:12.932025 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:12.932679 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] [instance: 3e1b5faf-7e07-4876-9370-ad143689d94d] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:12.939069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:12.939595 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:12.940027 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:12.940716 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:12.941172 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:12.941594 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:12.955455 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] HTTP exception thrown: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Request method failure captured: Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d HTTP/1.1 Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR-2BPgxh3azAsbQQOS7fkqe8_bQXnXgstedZpO4ZDCD7HEQoObsXjQwfnkimRdIxaPFMn-uDKqZJ9Ncgi7gGqbw2B8FwAqWySOcxwYmeWQo5-mMxAFP33UnAG8AcbnXlLcoBBs_SkA8MttMhtRzoY-tVvpdQI8-cnZs9FwyGuap0io Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:26:12.956962 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_40982cedd7d840248a05e55d65606b7c", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/40982cedd7d840248a05e55d65606b7c"}]}] Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 40982cedd7d840248a05e55d65606b7c Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-353441050 Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: fdba9c71297941608b065dbc3b2015ce Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-AttachVolumeTestJSON-353441050-project Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.958522 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '3e1b5faf-7e07-4876-9370-ad143689d94d'} Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:12.959508 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. Aug 29 20:26:12.961071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:12.962512 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] Returning 404 to user: Instance 3e1b5faf-7e07-4876-9370-ad143689d94d could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:12.962512 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-70d4211a-dc91-41c7-a9a9-e813e98eaed1 tempest-AttachVolumeTestJSON-353441050 tempest-AttachVolumeTestJSON-353441050-project] 10.222.0.121 "GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d" status: 404 len: 111 microversion: 2.1 time: 0.030713 Aug 29 20:26:12.962512 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 537/1090] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:12 2022] GET /compute/v2.1/servers/3e1b5faf-7e07-4876-9370-ad143689d94d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:23.866986 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:23.868277 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:23.873819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-427c9245-cd7a-4376-8825-3da684868eb4 req-43db0da7-2b9b-439f-938e-c2ba46266647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cec8d92-b96e-4c8a-a010-384124fb6248", "tag": "1477bb14-bbd7-4b05-8df2-1bdeca091ad8"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:23.875600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:23.876423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:23.878583 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:23.879454 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:23.880239 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:23.881556 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:23.882179 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:23.882761 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:23.897049 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:23.898643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:23.901874 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-427c9245-cd7a-4376-8825-3da684868eb4 req-43db0da7-2b9b-439f-938e-c2ba46266647 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:23.902623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-427c9245-cd7a-4376-8825-3da684868eb4 req-43db0da7-2b9b-439f-938e-c2ba46266647 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:23.903329 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-427c9245-cd7a-4376-8825-3da684868eb4 req-43db0da7-2b9b-439f-938e-c2ba46266647 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:23.917656 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:26:23.924244 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-427c9245-cd7a-4376-8825-3da684868eb4 req-43db0da7-2b9b-439f-938e-c2ba46266647 service nova] Creating event network-changed:1477bb14-bbd7-4b05-8df2-1bdeca091ad8 for instance 0cec8d92-b96e-4c8a-a010-384124fb6248 on hv-cinder-85426 Aug 29 20:26:23.932791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-427c9245-cd7a-4376-8825-3da684868eb4 req-43db0da7-2b9b-439f-938e-c2ba46266647 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067710 Aug 29 20:26:23.933982 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 538/1091] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:24.031301 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e015a2d2-03da-4152-b6e3-152eeff6f532 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "DELETE /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 204 len: 0 microversion: 2.1 time: 0.167658 Aug 29 20:26:24.035576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 554/1092] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:26:23 2022] DELETE /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:26:24.047423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:24.047423 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:24.051117 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:24.051117 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:24.051117 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:24.051117 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:24.051543 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:24.051543 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:24.200711 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:24.209673 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-53de4336-7983-42cd-9137-58eff2539969 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.172853 Aug 29 20:26:24.210239 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 539/1093] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:24 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:25.231997 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:25.232859 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:25.239832 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:25.240442 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:25.240990 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:25.241786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:25.243992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:25.243992 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:25.399883 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:25.408136 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e97748b0-355b-438b-840b-f8b8ad3c2d16 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1569 microversion: 2.1 time: 0.181079 Aug 29 20:26:25.408706 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 555/1094] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:25 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:26.322290 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-cdd94d88-b6fd-4983-92a2-9066a338d6ba req-def1f8d0-edfc-4e9c-b3e0-8b1253254047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cec8d92-b96e-4c8a-a010-384124fb6248", "name": "network-vif-deleted", "tag": "1477bb14-bbd7-4b05-8df2-1bdeca091ad8"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:26.332804 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-cdd94d88-b6fd-4983-92a2-9066a338d6ba req-def1f8d0-edfc-4e9c-b3e0-8b1253254047 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:26.333383 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-cdd94d88-b6fd-4983-92a2-9066a338d6ba req-def1f8d0-edfc-4e9c-b3e0-8b1253254047 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:26.333832 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-cdd94d88-b6fd-4983-92a2-9066a338d6ba req-def1f8d0-edfc-4e9c-b3e0-8b1253254047 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:26.345113 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-cdd94d88-b6fd-4983-92a2-9066a338d6ba req-def1f8d0-edfc-4e9c-b3e0-8b1253254047 service nova] Creating event network-vif-deleted:1477bb14-bbd7-4b05-8df2-1bdeca091ad8 for instance 0cec8d92-b96e-4c8a-a010-384124fb6248 on hv-cinder-85426 Aug 29 20:26:26.350452 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-cdd94d88-b6fd-4983-92a2-9066a338d6ba req-def1f8d0-edfc-4e9c-b3e0-8b1253254047 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031844 Aug 29 20:26:26.351021 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 540/1095] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:26.429701 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:26.430262 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:26.437219 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:26.437719 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:26.438156 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:26.438861 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:26.439354 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:26.439781 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:26.503428 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6996fd3733504e89ac78fa33ca9158ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2913c266bd434f4dbb8eef6fb9a862fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:26.511559 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b82c24a-785d-4656-a225-053fa454cee3 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 200 len: 1221 microversion: 2.1 time: 0.086361 Aug 29 20:26:26.525424 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 556/1096] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:26 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:26.655515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-97068175"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:26.656230 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:26.686603 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:26.687493 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:26.688374 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:26.689613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:26.690224 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:26.690664 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:26.880092 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.network.security_group_api [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Removing security group b5e417cb-a147-4c6c-b147-10fa890cb4de from port fc3f766a-0e07-4ece-96a4-a1240a4d2219 Aug 29 20:26:27.205795 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-767c4cef-10e4-4a17-9635-fc915facde5d tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/action" status: 202 len: 0 microversion: 2.1 time: 0.558299 Aug 29 20:26:27.206607 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 541/1097] 10.222.0.121 () {60 vars in 1283 bytes} [Mon Aug 29 20:26:26 2022] POST /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:26:27.215422 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-be21d2a0-d4f4-42b2-b7c7-b1a72836bb6b req-3555b0d4-be7d-4f41-8ac9-04ca17e779ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cde5aed-13d5-4add-aa8c-5cab126655ff", "tag": "fc3f766a-0e07-4ece-96a4-a1240a4d2219"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:27.243231 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be21d2a0-d4f4-42b2-b7c7-b1a72836bb6b req-3555b0d4-be7d-4f41-8ac9-04ca17e779ea service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:27.244085 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be21d2a0-d4f4-42b2-b7c7-b1a72836bb6b req-3555b0d4-be7d-4f41-8ac9-04ca17e779ea service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:27.244726 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-be21d2a0-d4f4-42b2-b7c7-b1a72836bb6b req-3555b0d4-be7d-4f41-8ac9-04ca17e779ea service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:27.258429 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-be21d2a0-d4f4-42b2-b7c7-b1a72836bb6b req-3555b0d4-be7d-4f41-8ac9-04ca17e779ea service nova] Creating event network-changed:fc3f766a-0e07-4ece-96a4-a1240a4d2219 for instance 8cde5aed-13d5-4add-aa8c-5cab126655ff on hv-cinder-85426 Aug 29 20:26:27.278714 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-be21d2a0-d4f4-42b2-b7c7-b1a72836bb6b req-3555b0d4-be7d-4f41-8ac9-04ca17e779ea service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068260 Aug 29 20:26:27.283700 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 557/1098] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:27.533542 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:27.534788 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] [instance: 0cec8d92-b96e-4c8a-a010-384124fb6248] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:27.549843 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:27.552001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:27.554689 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:27.555540 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:27.556222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:27.556746 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:27.574473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] HTTP exception thrown: Instance 0cec8d92-b96e-4c8a-a010-384124fb6248 could not be found. Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Request method failure captured: Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 HTTP/1.1 Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDR-6YpDzKf4or541y_h0eVXoYfldEeQwX4YCne4MrFx0YJTrKWxTM28cYY49_DMVmEpZupsIEf7nJ7IPn62uChCQO_1rcY7zPC6-4_-NPQoK8bYk9ZHI2X5_0hQVpoqiIzgRTZYDbeBP4G6Ho-8ea3UX4bAj3hf78BrtirR6KyLs-E4 Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 2913c266bd434f4dbb8eef6fb9a862fd Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-TestShelveInstance-1830366338 Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:26:27.576184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/2913c266bd434f4dbb8eef6fb9a862fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/2913c266bd434f4dbb8eef6fb9a862fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_2913c266bd434f4dbb8eef6fb9a862fd", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/2913c266bd434f4dbb8eef6fb9a862fd"}]}] Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-TestShelveInstance-1830366338 Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 2913c266bd434f4dbb8eef6fb9a862fd Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-TestShelveInstance-1830366338 Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-TestShelveInstance-1830366338-project Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: 6996fd3733504e89ac78fa33ca9158ed Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-TestShelveInstance-1830366338-project Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 0cec8d92-b96e-4c8a-a010-384124fb6248 could not be found. Aug 29 20:26:27.578251 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '0cec8d92-b96e-4c8a-a010-384124fb6248'} Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cec8d92-b96e-4c8a-a010-384124fb6248 could not be found. Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:27.579934 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cec8d92-b96e-4c8a-a010-384124fb6248 could not be found. Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cec8d92-b96e-4c8a-a010-384124fb6248 could not be found. Aug 29 20:26:27.582307 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:27.587169 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Returning 404 to user: Instance 0cec8d92-b96e-4c8a-a010-384124fb6248 could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:27.587169 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-51a1a6d0-4ab6-4d4b-b15d-62fd0126230f tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248" status: 404 len: 111 microversion: 2.1 time: 0.048381 Aug 29 20:26:27.587169 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 542/1099] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:27 2022] GET /compute/v2.1/servers/0cec8d92-b96e-4c8a-a010-384124fb6248 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:27.955444 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1f820ee-9cb3-4d8c-b283-ffe1243c3052 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] Calling method '.version_select at 0x7f446cca4550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:27.978458 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1f820ee-9cb3-4d8c-b283-ffe1243c3052 tempest-TestShelveInstance-1830366338 tempest-TestShelveInstance-1830366338-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-61233733" status: 202 len: 0 microversion: 2.1 time: 0.027461 Aug 29 20:26:27.979574 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 558/1100] 10.222.0.121 () {58 vars in 1253 bytes} [Mon Aug 29 20:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-61233733 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:26:28.617440 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:28.618017 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:28.624715 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:28.625204 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:28.625636 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:28.626344 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:28.626798 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:28.627260 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:28.726155 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lazy-loading 'services' on Instance uuid 8cde5aed-13d5-4add-aa8c-5cab126655ff {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:26:28.808515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-10d55fd9-742e-42df-8e3f-f919dd09d998 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments/b5fbf65e-d602-48a6-a170-a93bfc3c3a09" status: 202 len: 0 microversion: 2.1 time: 0.196079 Aug 29 20:26:28.809572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 543/1101] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:26:28 2022] DELETE /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments/b5fbf65e-d602-48a6-a170-a93bfc3c3a09 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:26:28.817884 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:28.820099 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:28.827483 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:28.828318 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:28.828977 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:28.829917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:28.830546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:28.831215 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:28.867489 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9badc1a2-f3d2-495c-8509-653507b9199e tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053656 Aug 29 20:26:28.868488 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 559/1102] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:26:28 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:29.309905 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-86e89aa2-afdc-4ad4-ab08-1d57fd493fbf req-f42824b7-be50-49d2-a382-279a8f28a136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cde5aed-13d5-4add-aa8c-5cab126655ff", "tag": "fc3f766a-0e07-4ece-96a4-a1240a4d2219"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:29.330997 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-86e89aa2-afdc-4ad4-ab08-1d57fd493fbf req-f42824b7-be50-49d2-a382-279a8f28a136 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:29.335601 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-86e89aa2-afdc-4ad4-ab08-1d57fd493fbf req-f42824b7-be50-49d2-a382-279a8f28a136 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:29.336452 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-86e89aa2-afdc-4ad4-ab08-1d57fd493fbf req-f42824b7-be50-49d2-a382-279a8f28a136 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:29.351195 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-86e89aa2-afdc-4ad4-ab08-1d57fd493fbf req-f42824b7-be50-49d2-a382-279a8f28a136 service nova] Creating event network-changed:fc3f766a-0e07-4ece-96a4-a1240a4d2219 for instance 8cde5aed-13d5-4add-aa8c-5cab126655ff on hv-cinder-85426 Aug 29 20:26:29.360849 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-86e89aa2-afdc-4ad4-ab08-1d57fd493fbf req-f42824b7-be50-49d2-a382-279a8f28a136 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053447 Aug 29 20:26:29.362993 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 544/1103] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:26:29.881319 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:29.884576 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:29.894405 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:29.894893 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:29.895374 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:29.896868 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:29.897322 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:29.899466 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:29.934585 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5ef4bab-4b3b-48dd-9f12-6af056524a64 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058206 Aug 29 20:26:29.935834 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 560/1104] 10.222.0.121 () {58 vars in 1307 bytes} [Mon Aug 29 20:26:29 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:26:29.947731 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:29.949040 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:29.955741 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:29.956229 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:29.956664 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:29.957370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:29.957827 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:29.958960 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:30.054892 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] HTTP exception thrown: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff is not attached to volume b5fbf65e-d602-48a6-a170-a93bfc3c3a09 Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Request method failure captured: Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: DELETE /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments/b5fbf65e-d602-48a6-a170-a93bfc3c3a09 HTTP/1.1 Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDSBtq2tOQj8g8Y8CM7HC5g750kg51Wd9c-7_AkkSX513AkdYbHreD3AZ9VFTpGdzck_VYo52VQ-12gHa0i6UM4oW0yyN06Ru7Xyw68eRaRiEA8mooweTp4hioznAd8mkn1mp72PNrStQwlic0tixfaS484dtGy6HRnFmeTCYDNZzHvI Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 412bd7ce029e414c9a9fa4726d4728cd Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-TestMinimumBasicScenario-1478928727 Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:26:30.057563 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/412bd7ce029e414c9a9fa4726d4728cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/412bd7ce029e414c9a9fa4726d4728cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_412bd7ce029e414c9a9fa4726d4728cd", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/412bd7ce029e414c9a9fa4726d4728cd"}]}] Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-TestMinimumBasicScenario-1478928727 Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 412bd7ce029e414c9a9fa4726d4728cd Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1478928727 Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-TestMinimumBasicScenario-1478928727-project Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: ae8cfa393c5f482b84105cf0c934b1d1 Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-TestMinimumBasicScenario-1478928727-project Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:26:30.059357 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff is not attached to volume b5fbf65e-d602-48a6-a170-a93bfc3c3a09 Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'server_id': '8cde5aed-13d5-4add-aa8c-5cab126655ff', 'id': 'b5fbf65e-d602-48a6-a170-a93bfc3c3a09'} Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b5fbf65e-d602-48a6-a170-a93bfc3c3a09. Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:30.060402 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff is not attached to volume b5fbf65e-d602-48a6-a170-a93bfc3c3a09 Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff is not attached to volume b5fbf65e-d602-48a6-a170-a93bfc3c3a09 Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:30.061872 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Returning 404 to user: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff is not attached to volume b5fbf65e-d602-48a6-a170-a93bfc3c3a09 {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:30.063783 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-233779da-bed1-4ae5-8efc-396446ed4fa0 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments/b5fbf65e-d602-48a6-a170-a93bfc3c3a09" status: 404 len: 154 microversion: 2.1 time: 0.116974 Aug 29 20:26:30.063783 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 545/1105] 10.222.0.121 () {58 vars in 1421 bytes} [Mon Aug 29 20:26:29 2022] DELETE /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff/os-volume_attachments/b5fbf65e-d602-48a6-a170-a93bfc3c3a09 => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:31.206055 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:31.207247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:31.214527 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:31.215367 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:31.215814 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:31.217158 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:31.217960 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:31.218654 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:31.248879 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:26:31.328673 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5c17cd15-877e-4944-bd04-14729366bd8c tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 204 len: 0 microversion: 2.1 time: 0.126374 Aug 29 20:26:31.331178 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 561/1106] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:26:31 2022] DELETE /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:26:31.339704 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:31.341024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:31.348012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:31.349297 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:31.349747 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:31.350459 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:31.350918 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:31.351370 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:31.500500 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:31.509473 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f303fc5e-d799-40d9-a3b3-a3791b8bd2e7 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1558 microversion: 2.1 time: 0.175131 Aug 29 20:26:31.511143 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 546/1107] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:31 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:32.531481 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:32.532759 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:32.539575 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:32.540063 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:32.540493 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:32.541192 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:32.541643 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:32.542070 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:32.679497 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:32.687336 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69b9a969-9b3f-4138-bb99-ec2e2aaf0929 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1558 microversion: 2.1 time: 0.160014 Aug 29 20:26:32.688082 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 562/1108] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:32 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:33.708806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:33.709420 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:33.716195 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:33.717002 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:33.717985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:33.718318 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:33.718773 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:33.719222 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:33.878506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cfa393c5f482b84105cf0c934b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412bd7ce029e414c9a9fa4726d4728cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:26:33.891225 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-d51f6548-4637-426a-b9fa-90c3a1795f20 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 200 len: 1558 microversion: 2.1 time: 0.186861 Aug 29 20:26:33.891806 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 547/1109] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:33 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:33.988830 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6aae6240-09ce-4579-bcd4-17d0d7c99fcf req-f35029eb-bc38-4e8a-9fcd-81d459b4b0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cde5aed-13d5-4add-aa8c-5cab126655ff", "name": "network-vif-deleted", "tag": "fc3f766a-0e07-4ece-96a4-a1240a4d2219"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:33.999509 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6aae6240-09ce-4579-bcd4-17d0d7c99fcf req-f35029eb-bc38-4e8a-9fcd-81d459b4b0e5 service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:34.000079 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6aae6240-09ce-4579-bcd4-17d0d7c99fcf req-f35029eb-bc38-4e8a-9fcd-81d459b4b0e5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:34.000567 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6aae6240-09ce-4579-bcd4-17d0d7c99fcf req-f35029eb-bc38-4e8a-9fcd-81d459b4b0e5 service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:34.014379 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6aae6240-09ce-4579-bcd4-17d0d7c99fcf req-f35029eb-bc38-4e8a-9fcd-81d459b4b0e5 service nova] Creating event network-vif-deleted:fc3f766a-0e07-4ece-96a4-a1240a4d2219 for instance 8cde5aed-13d5-4add-aa8c-5cab126655ff on hv-cinder-85426 Aug 29 20:26:34.019449 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6aae6240-09ce-4579-bcd4-17d0d7c99fcf req-f35029eb-bc38-4e8a-9fcd-81d459b4b0e5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034440 Aug 29 20:26:34.020930 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 563/1110] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:34.912158 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:34.912836 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] [instance: 8cde5aed-13d5-4add-aa8c-5cab126655ff] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:26:34.919863 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:34.920449 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:34.921043 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:34.922009 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:26:34.922584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:26:34.923012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:26:34.938966 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.wsgi [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] HTTP exception thrown: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff could not be found. Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Request method failure captured: Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: request: GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff HTTP/1.1 Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept: application/json Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Accept-Encoding: identity Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Connection: close Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Length: 0 Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Content-Type: application/json Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Host: 10.222.0.121 Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: Openstack-System-Scope: None Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: User-Agent: python-urllib3/1.26.12 Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Auth-Token: gAAAAABjDSBtq2tOQj8g8Y8CM7HC5g750kg51Wd9c-7_AkkSX513AkdYbHreD3AZ9VFTpGdzck_VYo52VQ-12gHa0i6UM4oW0yyN06Ru7Xyw68eRaRiEA8mooweTp4hioznAd8mkn1mp72PNrStQwlic0tixfaS484dtGy6HRnFmeTCYDNZzHvI Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Id: None Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Domain-Name: None Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Identity-Status: Confirmed Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Is-Admin-Project: True Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Id: default Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Domain-Name: Default Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Id: 412bd7ce029e414c9a9fa4726d4728cd Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Project-Name: tempest-TestMinimumBasicScenario-1478928727 Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Role: reader,member Aug 29 20:26:34.940526 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Roles: reader,member Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/412bd7ce029e414c9a9fa4726d4728cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/412bd7ce029e414c9a9fa4726d4728cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_412bd7ce029e414c9a9fa4726d4728cd", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/412bd7ce029e414c9a9fa4726d4728cd"}]}] Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant: tempest-TestMinimumBasicScenario-1478928727 Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Id: 412bd7ce029e414c9a9fa4726d4728cd Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1478928727 Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User: tempest-TestMinimumBasicScenario-1478928727-project Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Id: default Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Domain-Name: Default Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Id: ae8cfa393c5f482b84105cf0c934b1d1 Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: X-User-Name: tempest-TestMinimumBasicScenario-1478928727-project Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: method: > Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: exception: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff could not be found. Aug 29 20:26:34.942012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: action_args: {'id': '8cde5aed-13d5-4add-aa8c-5cab126655ff'} Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff could not be found. Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:34.943643 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff could not be found. Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff could not be found. Aug 29 20:26:34.944897 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.946001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Returning 404 to user: Instance 8cde5aed-13d5-4add-aa8c-5cab126655ff could not be found. {{(pid=120721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:34.946001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f2ae7d06-0477-49b4-9f3e-75bd5a5ed686 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff" status: 404 len: 111 microversion: 2.1 time: 0.034291 Aug 29 20:26:34.946001 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 548/1111] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:26:34 2022] GET /compute/v2.1/servers/8cde5aed-13d5-4add-aa8c-5cab126655ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:34.951889 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2a0f179-2c6d-4d70-bb33-8f1cd55dc051 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] Calling method '.version_select at 0x7f44697ddee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:34.970665 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2a0f179-2c6d-4d70-bb33-8f1cd55dc051 tempest-TestMinimumBasicScenario-1478928727 tempest-TestMinimumBasicScenario-1478928727-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-836855821" status: 202 len: 0 microversion: 2.1 time: 0.022905 Aug 29 20:26:34.971637 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 564/1112] 10.222.0.121 () {58 vars in 1274 bytes} [Mon Aug 29 20:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-836855821 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:27:01.252612 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-459674117", "imageRef": "3a8e2594-72ce-4051-95e1-bfab6d0f8c3e", "flavorRef": "452"}} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:01.259866 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_api:SELECT=22 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:01.260506 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:01.306910 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.network.neutron [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] validate_networks() for None {{(pid=120721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:27:01.576276 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Flavor limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:27:01.576696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Image limits 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:27:01.577166 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Flavor pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:27:01.577572 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Image pref 0:0:0 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:27:01.577981 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.virt.hardware [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:27:01.588577 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:01.589050 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:01.589495 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:01.590190 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:01.590641 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:01.591067 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:01.607187 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Getting quotas for project 4f4cb1d2943d4ae59ae7d7d52ec8777a. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:27:01.611069 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.quota [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Getting quotas for user b9c124be286749929b8fbf6fca75242d and project 4f4cb1d2943d4ae59ae7d7d52ec8777a. Resources: {'ram', 'cores', 'instances'} {{(pid=120721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:27:01.621831 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Going to run 1 instances... {{(pid=120721) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:27:01.624094 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a8e2594-72ce-4051-95e1-bfab6d0f8c3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:27:01.670260 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1afb6cc2-a324-4b94-8450-57e91bc777b8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.421930 Aug 29 20:27:01.670901 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 549/1113] 10.222.0.121 () {60 vars in 1152 bytes} [Mon Aug 29 20:27:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 20:27:01.680133 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:01.681202 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:01.687309 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11aff3b3-76ab-4f60-8e71-ba25b2aea07c tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:01.688256 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11aff3b3-76ab-4f60-8e71-ba25b2aea07c tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:01.757354 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-11aff3b3-76ab-4f60-8e71-ba25b2aea07c tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:01.764448 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11aff3b3-76ab-4f60-8e71-ba25b2aea07c tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1218 microversion: 2.1 time: 0.086118 Aug 29 20:27:01.765015 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 565/1114] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:01 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:02.785931 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-000a2a41-b9ba-4a90-adf2-fbaffbb28c35 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:02.786576 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-000a2a41-b9ba-4a90-adf2-fbaffbb28c35 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:02.839230 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-000a2a41-b9ba-4a90-adf2-fbaffbb28c35 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:02.846584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-000a2a41-b9ba-4a90-adf2-fbaffbb28c35 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1218 microversion: 2.1 time: 0.065350 Aug 29 20:27:02.847147 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 550/1115] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:02 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:03.867128 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bacfad22-f946-4b18-95ce-f4e882865636 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:03.867786 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bacfad22-f946-4b18-95ce-f4e882865636 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:03.922722 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bacfad22-f946-4b18-95ce-f4e882865636 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:03.930822 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bacfad22-f946-4b18-95ce-f4e882865636 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1218 microversion: 2.1 time: 0.068142 Aug 29 20:27:03.931423 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 566/1116] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:03 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:04.950904 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-129cebf8-d837-4b5f-9264-b3f81499cd49 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:04.951548 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-129cebf8-d837-4b5f-9264-b3f81499cd49 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:05.006687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-129cebf8-d837-4b5f-9264-b3f81499cd49 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:05.013215 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-129cebf8-d837-4b5f-9264-b3f81499cd49 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1218 microversion: 2.1 time: 0.066145 Aug 29 20:27:05.013790 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 551/1117] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:04 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:06.033051 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:06.033655 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:06.040862 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:06.041341 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:06.041770 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:06.042502 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:06.042955 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:06.043402 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:06.102923 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:06.113448 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e704c83f-af57-4e29-b212-7010272c3dea tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1222 microversion: 2.1 time: 0.083827 Aug 29 20:27:06.114020 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 567/1118] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:06 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:07.135587 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:07.136310 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:07.142912 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:07.143416 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:07.143847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:07.144551 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:07.144999 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:07.145420 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:07.209644 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:07.217444 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-9cf4b7b8-95c8-4fc1-9b48-a42bb448be39 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1276 microversion: 2.1 time: 0.086536 Aug 29 20:27:07.218511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 552/1119] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:07 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:08.207043 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d63285ae-ecec-491d-9abb-5b6cf53d6043 req-349093fa-52d1-48bc-af4e-df2d188356ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc313224-6fe8-4eb3-bd85-0337e6b0a4df", "tag": "e890c6b4-38e1-4fc4-81f8-9e8a9a998474"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:08.222003 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d63285ae-ecec-491d-9abb-5b6cf53d6043 req-349093fa-52d1-48bc-af4e-df2d188356ce service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:08.222586 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d63285ae-ecec-491d-9abb-5b6cf53d6043 req-349093fa-52d1-48bc-af4e-df2d188356ce service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:08.223103 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d63285ae-ecec-491d-9abb-5b6cf53d6043 req-349093fa-52d1-48bc-af4e-df2d188356ce service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:08.237258 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d63285ae-ecec-491d-9abb-5b6cf53d6043 req-349093fa-52d1-48bc-af4e-df2d188356ce service nova] Creating event network-changed:e890c6b4-38e1-4fc4-81f8-9e8a9a998474 for instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df on hv-cinder-85426 Aug 29 20:27:08.239364 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:08.239975 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:08.242664 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d63285ae-ecec-491d-9abb-5b6cf53d6043 req-349093fa-52d1-48bc-af4e-df2d188356ce service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039497 Aug 29 20:27:08.243787 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 568/1120] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:08.247071 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:08.247590 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:08.248024 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:08.248894 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:08.249386 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:08.249868 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:08.392559 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:08.400438 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-edc1bc54-92c0-4fd1-a585-959ea4ecb70e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1318 microversion: 2.1 time: 0.165283 Aug 29 20:27:08.401012 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 553/1121] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:08 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:09.420811 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:09.421536 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:09.428637 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:09.429123 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:09.429554 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:09.430250 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:09.430702 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:09.431144 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:09.563606 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:09.571283 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2034de4f-8eeb-4e95-9150-af4e4329622e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1318 microversion: 2.1 time: 0.154772 Aug 29 20:27:09.571849 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 569/1122] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:09 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:10.591791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:10.592501 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:10.598937 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:10.599454 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:10.600124 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:10.600819 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:10.601274 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:10.601696 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:10.736702 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:10.744927 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-05b55961-4575-43b4-ae80-b8a1d4d31452 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1318 microversion: 2.1 time: 0.156955 Aug 29 20:27:10.745515 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 554/1123] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:10 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:11.765767 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:11.766378 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:11.772965 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:11.773444 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:11.773876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:11.774567 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:11.775029 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:11.775476 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:11.908389 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:11.916562 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b80174fa-5e34-4d3f-a265-46a60167e89a tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1318 microversion: 2.1 time: 0.154654 Aug 29 20:27:11.917120 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 570/1124] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:11 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:12.634113 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [req-6525c0f9-8ab0-45d7-953b-e5cb2fd0f8bb req-3cef416f-046d-4ff9-bd0e-cf20358ee29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc313224-6fe8-4eb3-bd85-0337e6b0a4df", "name": "network-vif-plugged", "status": "completed", "tag": "e890c6b4-38e1-4fc4-81f8-9e8a9a998474"}]} {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:12.639623 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=2 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:12.645687 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-6525c0f9-8ab0-45d7-953b-e5cb2fd0f8bb req-3cef416f-046d-4ff9-bd0e-cf20358ee29d service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:12.646408 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-6525c0f9-8ab0-45d7-953b-e5cb2fd0f8bb req-3cef416f-046d-4ff9-bd0e-cf20358ee29d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:12.647472 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [req-6525c0f9-8ab0-45d7-953b-e5cb2fd0f8bb req-3cef416f-046d-4ff9-bd0e-cf20358ee29d service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:12.658877 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.compute.server_external_events [req-6525c0f9-8ab0-45d7-953b-e5cb2fd0f8bb req-3cef416f-046d-4ff9-bd0e-cf20358ee29d service nova] Creating event network-vif-plugged:e890c6b4-38e1-4fc4-81f8-9e8a9a998474 for instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df on hv-cinder-85426 Aug 29 20:27:12.664432 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [req-6525c0f9-8ab0-45d7-953b-e5cb2fd0f8bb req-3cef416f-046d-4ff9-bd0e-cf20358ee29d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034411 Aug 29 20:27:12.665136 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 555/1125] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:12.937288 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:12.937915 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:12.945007 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:12.945482 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:12.945917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:12.946600 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:12.947050 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:12.947564 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:13.074689 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:13.082323 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52b47c4f-286c-4fa7-b137-15df8dd987d8 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1318 microversion: 2.1 time: 0.148940 Aug 29 20:27:13.082876 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 571/1126] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:12 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:14.104132 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:14.104751 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:14.110847 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:14.111359 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:14.111797 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:14.112484 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:14.112943 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:14.113368 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:14.246913 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:14.254985 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-8e61f14a-f5d7-48e4-bd5d-f95a2c0ed796 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1318 microversion: 2.1 time: 0.155761 Aug 29 20:27:14.255584 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 556/1127] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:14 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:15.275677 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:15.276287 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:15.278247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:15.284106 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:15.284595 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:15.285033 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:15.285727 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:15.286186 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:15.286613 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:15.415779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:15.423353 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57be0d5f-f7a5-484c-87c2-99d9aea7e06e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1468 microversion: 2.1 time: 0.152064 Aug 29 20:27:15.423919 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 572/1128] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:15 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:15.467564 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:15.468077 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:15.470096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG dbcounter [-] [120721] Writing DB stats nova_cell0:SELECT=10 {{(pid=120721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:15.476369 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:15.476849 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:15.477280 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:15.477979 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:15.478706 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:15.479212 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:15.504355 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Going to try to terminate instance {{(pid=120721) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:27:15.578426 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-f899dc6f-3a45-49c6-a6aa-4c7581d0e9e2 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "DELETE /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 204 len: 0 microversion: 2.1 time: 0.114412 Aug 29 20:27:15.579096 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 557/1129] 10.222.0.121 () {58 vars in 1244 bytes} [Mon Aug 29 20:27:15 2022] DELETE /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:27:15.588116 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:15.589401 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:15.595939 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:15.596421 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:15.596845 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:15.597529 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:15.597979 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:15.598396 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:15.724591 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:15.732779 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1519bdff-5305-4486-ac56-0de67ffa959f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1474 microversion: 2.1 time: 0.149263 Aug 29 20:27:15.733343 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 573/1130] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:15 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1474 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:16.754511 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:16.755234 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:16.761678 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:16.762184 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:16.762613 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:16.763333 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:16.763787 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:16.764210 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:16.900102 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:16.907969 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-1d41a1b4-b887-40fe-8b20-2e71dc32b4c4 tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1474 microversion: 2.1 time: 0.158069 Aug 29 20:27:16.908537 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 558/1131] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:16 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:17.477631 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c03109cc-df18-4dd9-a991-4bb9869ba9e8 req-43e2a512-d138-4ea2-9643-205661afc5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc313224-6fe8-4eb3-bd85-0337e6b0a4df", "name": "network-vif-deleted", "tag": "e890c6b4-38e1-4fc4-81f8-9e8a9a998474"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:27:17.488780 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c03109cc-df18-4dd9-a991-4bb9869ba9e8 req-43e2a512-d138-4ea2-9643-205661afc5dc service nova] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.489275 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c03109cc-df18-4dd9-a991-4bb9869ba9e8 req-43e2a512-d138-4ea2-9643-205661afc5dc service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.489692 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c03109cc-df18-4dd9-a991-4bb9869ba9e8 req-43e2a512-d138-4ea2-9643-205661afc5dc service nova] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:17.503357 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c03109cc-df18-4dd9-a991-4bb9869ba9e8 req-43e2a512-d138-4ea2-9643-205661afc5dc service nova] Creating event network-vif-deleted:e890c6b4-38e1-4fc4-81f8-9e8a9a998474 for instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df on hv-cinder-85426 Aug 29 20:27:17.509303 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c03109cc-df18-4dd9-a991-4bb9869ba9e8 req-43e2a512-d138-4ea2-9643-205661afc5dc service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035366 Aug 29 20:27:17.509911 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 574/1132] 10.222.0.121 () {64 vars in 1322 bytes} [Mon Aug 29 20:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:17.930655 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.api.openstack.wsgi [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:17.931316 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.compute.api [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120721) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:17.938300 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.938791 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.939275 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:17.939956 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.940414 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.941883 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:17.975171 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:17.975757 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:17.976207 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG oslo_concurrency.lockutils [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:17.976660 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.objects.instance [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lazy-loading 'fault' on Instance uuid dc313224-6fe8-4eb3-bd85-0337e6b0a4df {{(pid=120721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:27:18.031876 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: DEBUG nova.policy [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c124be286749929b8fbf6fca75242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4cb1d2943d4ae59ae7d7d52ec8777a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120721) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:27:18.039456 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: INFO nova.api.openstack.requestlog [None req-c67060d8-da25-4273-8d3f-3527ef36fe6f tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 200 len: 1308 microversion: 2.1 time: 0.113711 Aug 29 20:27:18.040058 dv-cinder-854262-2-iscsi devstack@n-api.service[120721]: [pid: 120721|app: 0|req: 559/1133] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:17 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:19.061228 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:19.061917 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] [instance: dc313224-6fe8-4eb3-bd85-0337e6b0a4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:27:19.068140 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:19.068617 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:19.069046 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:19.069732 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Acquiring lock "05f1666c-b639-455a-b175-1a63fa7e82b0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:27:19.070182 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:27:19.070604 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Lock "05f1666c-b639-455a-b175-1a63fa7e82b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:27:19.083422 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] HTTP exception thrown: Instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df could not be found. Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Request method failure captured: Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df HTTP/1.1 Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Connection: close Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Host: 10.222.0.121 Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjDSETaW3MEiBsxTZQH_Q7b6MUlqt9lQB8j0JpwHwlOHf0K39g1s_jnRtwCAEAAbSXPuxzBSuUbd80VouhjynyA90kbYW3wuG5Nx9HLXQu1aNnkeUfOqNW5SZ24phmqT1aAuc3SHEZcGq5iV1bFYOHPzYMCQVjlpl_S82qK7ZXhCOab90 Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Id: 4f4cb1d2943d4ae59ae7d7d52ec8777a Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-198653305 Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 29 20:27:19.085530 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/4f4cb1d2943d4ae59ae7d7d52ec8777a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/4f4cb1d2943d4ae59ae7d7d52ec8777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_4f4cb1d2943d4ae59ae7d7d52ec8777a", "adminURL": "http://10.222.0.121:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/4f4cb1d2943d4ae59ae7d7d52ec8777a"}]}] Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-198653305 Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 4f4cb1d2943d4ae59ae7d7d52ec8777a Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-198653305 Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-198653305-project Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Id: b9c124be286749929b8fbf6fca75242d Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-198653305-project Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: method: > Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: exception: Instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df could not be found. Aug 29 20:27:19.087511 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: action_args: {'id': 'dc313224-6fe8-4eb3-bd85-0337e6b0a4df'} Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df could not be found. Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:27:19.088546 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df could not be found. Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df could not be found. Aug 29 20:27:19.090247 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 29 20:27:19.091778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] Returning 404 to user: Instance dc313224-6fe8-4eb3-bd85-0337e6b0a4df could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:27:19.091778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-406a8bd9-16f6-4b76-91bf-354a34b3ef1e tempest-VolumesNegativeTest-198653305 tempest-VolumesNegativeTest-198653305-project] 10.222.0.121 "GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df" status: 404 len: 111 microversion: 2.1 time: 0.030431 Aug 29 20:27:19.091778 dv-cinder-854262-2-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 575/1134] 10.222.0.121 () {58 vars in 1241 bytes} [Mon Aug 29 20:27:19 2022] GET /compute/v2.1/servers/dc313224-6fe8-4eb3-bd85-0337e6b0a4df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)